QUALITY  OF  CARE  IN  THE  NEW  MEXICO 
MEDICAID  PROGRAM 
(1971-1975) 

The  Effect  of  the  New  Mexico  Experimental  Medical  Care 
Review  Organization  on  the  Use  of  Antibiotics  for 
Common  Infectious  Diseases 


PREPARED  EOR  THE  U.S.  DEPARTMENT  OF  HEALTH,  EDUCATION, 

AND  WELFARE 


Kathleen  N.  Lohr,  Robert  H.  Brook,  and  Michael  A.  Kaufman 
with  the  assistance  of  Bryant  Mori,  Caren  J.  Kamberg,  and  Larry  Miller 


V< ,  >  '      '  1 1 


The  research  reported  here  was  performed  in  part  as  one  element  of  a 
longer  project  sponsored  by  the  Officer  of  the  Assistant  Secretary  for 
Planning  and  Evaluation,  U.S.  Department  of  Health,  Education,  and 
Welfare,  under  Contract  No.  HE  W-100-76-0180,  and  in  part  pursuant  to 
the  Health  Insurance  Study  grant  from  the  U.S.  Department  of  Health, 
Education,  and  Welfare.  Preparation  of  this  report  was  also  assisted  by 
a  grant  from  the  Robert  Wood  Johnson  Foundation,  Princeton,  New 
Jersey. 


ISBN  0-8330-0217-1 
LC  Card  No.  80-14275 


The  Rand  Publications  Series:  The  Report  is  the  principal  publication  doc- 
umenting and  transmitting  Rand's  major  research  findings  and  final  research 
results.  The  Rand  Note  reports  other  outputs  of  sponsored  research  for 
general  distribution.  Publications  of  The  Rand  Corporation  do  not  neces- 
sarily reflect  the  opinions  or  policies  of  the  sponsors  of  Rand  research. 


Reprinted  from  Supplement  to  Medical  Care,  Volume  18,  Number  1, 
January  1980,  J.  B.  Lippincott  Co.,  Philadelphia,  Pennsylvania. 


Published  by  The  Rand  Corporation 


QUALITY  OF  CARE  IN  THE  NEW  MEXICO 

MEDICAID  PROGRAM 

(1971-1975) 

The  Effect  of  the  New  Mexico  Experimental  Medical  Care 

Review  Organization  on  the  Use  of  Antibiotics  for 

Common  Infectious  Diseases 

PREPARED  FOR  THE  U.S.  DEPARTMENT  OF  HEALTH,  EDUCATION. 

AND  WELFARE 

Kathleen  N.  Lohr,  Robert  H.  Brook,  and  Michael  A.  Kaufman 

with  the  assistance  of  Bryant  Mori,  Caren  J. 

Kamberg,  and  Larry  Miller 

R-2513-HEW 

JANUARY  1980 

Rand 

SANTA  MONICA,  CA.  90406 

Acknowledgments 


We  wish  to  acknowledge  a  number  of  persons  who,  by 
their  expertise  and  cooperation,  contributed  substantially  to 
this  study. 

In  particular,  the  authors  extend  their  gratitude  to  the 
following  persons  affiliated  with  the  New  Mexico  peer  re- 
view system:  George  Boyden,  Principal  Investigator  of  the 
Experimental  Medical  Care  Review  Organization;  David 
Farrell,  Assistant  Executive  Director  of  the  New  Mexico 
Professional  Standards  Review  Organization;  and  Richard 
Heim,  former  Director  of  the  Health  and  Social  Services 
Department  of  the  State  of  New  Mexico,  who  was  responsi- 
ble for  much  of  the  development  of  the  peer  review  system 
as  a  whole. 

Several  members  of  the  staff  of  The  Dikewood  Corpora- 
tion (the  fiscal  intermediary)  were  instrumental  in  facilitat- 
ing the  development  of  this  study.  Particular  credit  should 
go  to  Robert  Flanagan,  Vice  President  of  Dikewood;  Wesley 
Curtis,  who  supervised  the  subcontract  that  provided  the 
data  tables  and  tapes;  and  Parkey  Johnson  and  John  Orman, 
who  devoted  careful  attention  to  the  programming  from 
which  the  final  tables  and  tapes  were  made. 

The  authors  are  indebted  to  several  members  of  the  Rand 
staff,  particularly  Joseph  Newhouse,  Albert  Williams  and 
John  Rolph,  for  their  support  and  assistance  during  this 
study.  We  are  grateful  as  well  for  the  outstanding  efforts  of 
Mary  Devine  in  preparing  several  drafts  of  this  report. 


iii 


CONTENTS 


Acknowledgments  iii 

I.  OVERVIEW  OF  THE  NEW  MEXICO  PEER  REVIEW  SYSTEM  1 

The  Medicaid-Eligible  Population  2 

The  New  Mexico  EMCRO  2 

Findings  of  the  First  2- Year  Study  4 

Methodologic  Notes  8 

II.  USE  OF  SELECTED  TYPES  OF  INJECTIONS  9 

Injections  Rilled  9 

Injections  Denied  9 

Population  Rates  of  Use  9 

Classes  of  Injections  12 

Class  I  12 

Class  II  14 

Class  III  15 

Discussion  15 


III.  PHYSICIAN  CHARACTERISTICS  AND  APPROPRIATE  USE 

OF  INJECTIONS  19 

Aggregate  Use  of  Visits  and  Injections  19 

Type  of  Practice  and  Provider  19 

Roard  Certification  Status  19 

Specialty  20 

Outlier  Physicians  20 

Summary  22 

Rates  of  Injection  Use  and  Denial  by  Ambulatory  Visit  22 

Type  of  Practice  and  Provider  22 

Roard  Certification  Status  22 

Specialty  24 

Outlier  Physicians  25 

Summary  26 

Implicit  Effect  of  EMCRO  on  Injections  27 

Discussion  27 

IV.  ANTIRIOTICS  AND  RESPIRATORY  INFECTIONS: 

A  REVIEW  OF  RELEVANT  LITERATURE  30 

Use  of  Antibiotics  30 

Prevalence  of  Drug  Use  30 


v 


Use  of  Oral  and  Injectable  Antibiotics  in  Outpatient  Practice  for 

Specific  Diagnoses  31 

Recommended  Uses  for  Antibiotics  33 

Toxic  Effects  of  Antibiotics  34 

Summary  36 
The  Relationship  Between  Physician  Characteristics  and  the  Choice  of 

Therapeutic  Agents  36 

Controversies  About  Appropriate  Management  of  Common  Respiratory  Infections  37 

Strep  Throat  37 

Otitis  Media  41 

Comment  41 

V.  RELATIONSHIPS  AMONG  DIAGNOSES,  INJECTIONS,  AND 

PHYSICIAN  CHARACTERISTICS  42 

Research  Questions  42 

Methods  42 

Results  44 

Treatment  of  Infectious  Diseases  by  Type  of  IM  Antibiotic  44 

Use  of  Injectable  Antibiotics  by  Diagnosis  47 

Changes  in  Diagnoses  Between  Periods  I  and  II  49 

Overall  Use  of  IM  Antibiotics  by  Physician  Type  55 

Use  of  Specific  IM  Antibiotics  by  Provider  Type  and  Diagnoses  56 

Treatment  of  "Sore  Throat":  A  Summary  Example  59 

Discussion  59 

VI.  QUALITY  OF  CARE  FOR  EPISODES  OF  COMMON 

RESPIRATORY  ILLNESSES  62 

Using  Episodes  of  Illness  in  Ambulatory  Care  Review  62 

Methods  64 

Study  Population  64 

Conditions  Studied  64 

Variables  64 

Data  Sources  65 

Creation  of  Disease-Specific  Episodes  67 

Analyses  69 

Results  70 

Distribution  of  Diagnosis-Specific  Episodes  71 

Overall  Use  of  Antibiotics  in  Disease-Specific  Episodes  72 

Quality  of  Care  by  Diagnosis  and  Physician  Type  75 

Summary  Comparisons  80 

Special  Analyses  81 

Quality  of  Care  by  Use  of  Laboratory  Tests  85 

Quality  of  Care  by  Revisit  Rates  87 

Summary:  Quality-of-Care  Evaluation  87 

Discussion  92 

Episode-of-Illness  Methods  92 

Quality-of-Care  Results  93 

VII.  SUMMARY  AND  CONCLUSIONS  95 
Principal  Findings  95 


vi 


Discussion  97 

Remaining  Quality-of-Care  Problems  97 

Other  Applications  for  the  Episode  Methods  98 

Long-Term  Objectives  of  a  PSRO  Program  100 

Costs  of  Peer  Review  102 

Summary  103 

REFERENCES  104 

APPENDIX  A.    Distribution  of  Services  in  Diagnosis-Specific  Episodes 

Specified  as  2,  3  or  4  Weeks  in  Length  107 

APPENDIX  B.    Percentage  Distribution  of  Antibiotic  Medications  in 

Diagnosis-Specific  Episodes,  By  Type  of  Drug,  Type  of 

Physician  and  Period  113 


vii 


I.  Overview  of  the  New  Mexico  Peer 
Review  System 


In  1971  A  peer  review  system  de- 
signed both  to  improve  the  quality  of  care 
and  to  control  the  use  and  costs  of  medical 
care  for  Medicaid  eligibles  became  opera- 
tional in  New  Mexico.  As  the  New  Mexico 
Experimental  Medical  Care  Review  Or- 
ganization (EMCRO),  it  functioned  for  4 
years,  reviewing  all  claims  for  payment  for 
services  rendered  for  inpatient  and 
ambulatory  care  for  the  entire  Medicaid 
population.  This  monograph  describes  the 
patterns  of  care  delivered  by  physicians 
participating  in  this  Medicaid  program  to 
patients  with  common  respiratory  or  other 
infectious  diseases,  and  highlights  certain 
changes  in  the  therapy  and  management  of 
such  conditions  that  were  brought  about  in 
part  by  EMCRO  activities.  In  particular, 
we  focus  on  the  ways  in  which  use  of  in- 
jectable drugs  shifted  over  time  and  on  the 
ways  that  entire  episodes  of  respiratory 
illnesses  were  managed  with  respect  to  in- 
jectable and  oral  antibiotics,  laboratory 
tests  and  physician  visits. 

The  investigations  reported  here  were  of 
several  types:  1)  overall  changes  in  use  of 
injections  by  pharmacologic  type  of  drug; 
2)  differences  in  injection  use  by  type  of 
physician;  3)  differences  in  injection  use 
by  physician  type  for  selected  ambulatory 
conditions;  and  4)  differences  in  quality  of 
care  for  entire  episodes  of  illness  by  physi- 
cian type.  Chapters  II,  III,  V,  and  VI  cover 
these  topics  respectively;  Chapter  IV  gives 
a  review  of  relevant  literature  on  the  use  of 
diagnostic  tests  and  antibiotics,  with  par- 
ticular attention  given  to  the  conditions 
studied  here. 

The  findings  from  this  research  have  at 
least  2  unique  elements.  First,  little  has 
been  published  about  the  ways  in  which 
different  types  of  physicians  in  private 
practice  choose  to  treat  common  illnesses. 
What  has  appeared  tends  to  focus  on  either 


small  numbers  of  patients  or  physicians  or 
on  a  single  institution's  practices;  except 
for  research  on  the  Tennessee  Medicaid 
population,  little  if  any  recent  literature 
documents  patterns  of  medical  practice  for 
large  population  groups,  especially  with 
respect  to  specific  diagnoses.  Thus,  even 
the  descriptive,  "epidemiologic''  findings 
reported  here  are  important  for  health  ser- 
vices researchers,  planners  and 
policymakers  for  questions  involving,  for 
example,  quality  of  care  for  common  acute 
illnesses,  service-specific  reimbursement 
policies  for  care  financed  by  federal  pro- 
grams, undergraduate  medical  and  con- 
tinuing education  programs,  and  incentives 
for  improved  ways  of  organizing  medical 
practice. 

Second,  our  previous  evaluations  of  the 
New  Mexico  EMCRO  focused  strictly  on 
rates  of  change  in  injectable  drug  use,  with 
no  control  for  changes  in  diagnostic  mix. 
Moreover,  certain  questions  remained — in 
particular,  whether  the  apparent  effect  of 
the  EMCRO  in  reducing  injection  use 
brought  about  undesirable  reactions 
among  Medicaid  physicians  (such  as,  for 
example,  unwarranted  increases  in  use  of 
oral  medications).  In  effect,  that  evaluation 
was  incomplete.  Thus,  the  results  pre- 
sented here,  especially  those  dealing  with 
specific  diagnoses  and  with  whole 
episodes  of  care,  make  the  evaluation  as- 
pects of  this  work  more  comprehensive 
and  more  valid. 

In  addition,  many  aspects  of  the  PSRO 
program  have  been  modeled  on  the  fea- 
tures of  the  EMCRO  program;  in  particu- 
lar, incorporation  of  certain  parts  of  the 
New  Mexico  EMCRO's  ambulatory  re- 
view system  into  future  PSROs  has  been 
suggested.  For  these  reasons,  evaluation  of 
the  New  Mexico  EMCRO  can  indicate  to 
policymakers  the  abilities  and  limitations 
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of  such  organizations  to  improve  or  at  least 
maintain  the  quality  of  medical  care,  espe- 
cially in  federally  funded  programs.  Such 
evaluation  can  also  highlight  topics  likely 
to  be  important  to  researchers  with  access 
to  similar  data  bases. 

The  Medicaid-Eligible  Population 

The  New  Mexico  Medicaid-eligible 
population  included  persons  in  4  major 
medical  aid  categories:  Aid  to  Families 
with  Dependent  Children  (AFDC);  Aid  to 
the  Permanently  and  Totally  Disabled 
(APTD);  Old  Age  Assistance  (OAA);  and 
Aid  to  the  Needy  Blind  (ANB).  Almost  72 
per  cent  of  all  eligibles  were  in  the  AFDC 
category;  apart  from  a  very  small  number  in 
ANB  (0.05  per  cent  of  the  total  population), 
the  remainder  were  split  almost  evenly  be- 
tween OAA  and  APTD  ( 14  and  15  per  cent, 
respectively).  More  detailed  descriptions 
of  the  eligible  population  are  contained  in 
Brook,  Williams  and  Rolph.8 

Four  eligibility  groups  had  been  defined 
in  previous  evaluations  according  to  the 
period  of  entitlement  of  care  under  the 
Medicaid  program.  Group  I  (people  con- 
tinuously enrolled  for  all  4  years)  is  the 
most  important  for  the  present  study.  Of  all 
eligibles  in  the  program,  more  than  40  per 
cent  were  in  Group  I  and  more  than  25  per 
cent  were  in  both  Group  I  and  AFDC.  This 
AFDC-I  population,  numbering  more  than 
21,000  persons,  formed  the  cohort  on 
which  the  episode-of-care  analyses  were 
carried  out  (see  Chapter  VI). 

As  might  be  expected  from  the  high  pro- 
portion of  AFDC  eligibles,  almost  45  per 
cent  of  the  eligible  population  were  chil- 
dren (aged  14  or  younger);  another  29  per 
cent  were  between  15  and  44  years  of  age; 
12  per  cent  were  between  ages  45  and  64; 
and  15  per  cent  were  aged  65  years  and 
older. 

Women  constituted  almost  60  per  cent  of 
the  eligible  population.  The  eligible  group 
was  overwhelmingly  white  (more  than  80 
per  cent);  the  next  largest  group  was 
American  Indians  (11  per  cent);  blacks 


made  up  5  per  cent  and  other  ethnic  groups 
4  per  cent  of  the  total  population. 

The  total  number  of  eligible-months 
over  the  4  years  was  4,056,897,  for  an  aver- 
age monthly  count  of  Medicaid  eligibles  of 
84,519.  Changes  in  demographic  charac- 
teristics of  the  eligible  population  over 
time  (e.g.,  age  distribution,  race  or  sex) 
were  very  small  and  did  not  need  to  be 
controlled  or  adjusted  for  in  this  study. 

The  New  Mexico  EMCRO 

The  New  Mexico  peer  review  system 
was  established  in  September  1971  and 
became  an  Experimental  Medical  Care 
Review  Organization  (EMCRO)  in  March 
1972;  through  August  1975  (the  time  span 
of  this  evaluation),  the  EMCRO  functioned 
much  as  present-day  Professional  Stan- 
dards Review  Organizations  (PSROs).# 
The  New  Mexico  EMCRO  was  formed  as  a 
3-part  organization — a  fiscal  intermediary 
component  (The  Dikewood  Corporation), 
a  peer  review  component  (the  New  Mexico 
Foundation  for  Medical  Care),  and  the 
State  Department  of  Health  and  Social 
Services  in  New  Mexico.  From  the  outset, 
the  New  Mexico  EMCRO  undertook  re- 
view of  all  medical  care  given  to  persons 
eligible  for  the  Medicaid  program.  Both 
inpatient  and  ambulatory  care  were  re- 
viewed by  means  of  a  comprehensive, 
computerized  system  involving  both  cleri- 
cal and  professional  (physician)  reviewers. 
All  services  for  which  payment  was  sought 
were  reviewed  against  administrative 
guidelines  that  covered  elements  such  as 
patient  eligibility  and  duplicate  claims. 
Claims  that  did  not  pass  administrative 
screening  were  not  reviewed  against 
quality-of-care  guidelines. 

For  ambulatory  care,  the  EMCRO  de- 
veloped a  review  system  that  facilitated 
assessment  of  the  quality  and  necessity  of 


#  The  historical  background  of  quality-assurance 
organizations,  such  as  Foundations  for  Medical  Care, 
EMCROs  and  PSROs,  can  be  found  elsewhere,6,7  as  can 
descriptions  of  various  PSRO  programs. 7-24-25,28,29,35,74 


2 


care  for  a  variety  of  services.  Special  em- 
phasis was  given  to  type  and  frequency  of 
injections  (by  diagnosis),  type  and  fre- 
quency of  laboratory  tests,  frequency  and 
level  of  office  visits,  and  the  need  for 
emergency  room  services.  Guidelines  for 
use  of  injections  and  office  visits  were  re- 
lated to  diagnoses.  Prescription  drugs  were 
not  subjected  to  peer  review.  Detailed 
procedure  codes  were  developed  (e.g.,  for 
injections)  to  aid  the  review  process;  mod- 
ifications to  the  California  Relative  Value 
Scale  were  used  for  coding  ambulatory  vis- 
its. At  the  beginning  of  its  operations,  the 
EMCRO  used  the  HICDA-I  (Hospital 
Adaptation  of  the  International  Classifica- 
tion of  Diseases,  Adapted  for  Use  in  the 
United  States)  to  code  diagnoses;  in  July 
1974,  it  switched  to  HICDA-II. 

Claims  for  ambulatory  services  (visits, 
injections,  laboratory  tests)  could  specify  1 
or  2  diagnoses;  incomplete  claims  lacking 
any  diagnosis  were  returned  to  the  physi- 
cian for  completion  before  either  review  or 
payment.  The  Dikewood  Corporation 
meticulously  coded  and  entered  claims 
into  the  data  base,  using  data-processing 
procedures  that  checked  for  coding  errors 
and  maximized  the  accuracy  of  the  infor- 
mation. For  example,  errors  in  physician 
identification  numbers  could  be  caught 
and  corrected  at  an  early  stage  and  dis- 
crepancies between  information  on  hard- 
copy claims  and  computer-stored  informa- 
tion could  be  identified  and  corrective 
steps  taken. 

Quality-of-care  review  was  done  in  2 
basic  steps.  First,  clerical  employees  of  the 
Foundation  screened  all  ambulatory 
claims  (except  prescriptions)  using 
guidelines  developed  by  physician  mem- 
bers of  the  EMCRO.  If  the  service  on  a 
claim  conformed  to  the  guidelines,  the 
physician  would  quite  likely  be  reim- 
bursed. Reimbursement  was  not  automa- 
tic, however,  because  some  claims  might 
be  subject  to  further  review  if  the  physician 
submitted  frequent  claims  for  the  same  pa- 
tient or  the  same  diagnosis  or  if  the  physi- 
cian's past  behavior  necessitated  frequent 


peer  review.  Most  antibiotic  injections 
were  subjected  to  physician  review  be- 
cause their  use  was  not  automatically  ap- 
proved for  many  diagnoses. 

Second,  if  information  on  claims,  when 
compared  with  guidelines,  indicated  po- 
tentially low  quality  of  care  or  inappropri- 
ate use,  the  claims  were  referred  to  physi- 
cian reviewers  for  a  decision  as  to  whether 
further  information  should  be  requested 
from  the  physician  or  payment  denied  for 
the  service  because  it  was  medically  inap- 
propriate, n  Because  of  the  computerized 
data  base  established  and  maintained  by 
the  EMCRO,  the  reviewing  physician  had 
access  to  up  to  10  types  of  patient  and 
physician  profiles  to  aid  him  in  making  a 
decision.  Based  on  this  information,  the 
physician  then  decided  whether  a  claim 
should  be  paid  or  denied  for  medical  rea- 
sons. If  the  claim  was  denied,**  the  re- 
viewing physician  was  required  to  state  a 
reason,  which  more  than  90  per  cent  of  the 
time  was  that  the  service  was  unwarranted 
for  the  diagnosis.  When  notified  of  the 
denial,  the  physician  who  had  given  the 
inappropriate  service  could  appeal  the  de- 
cision of  the  reviewing  physician  to  an 
appeals  review  committee.  All  physicians 
who  treated  Medicaid  patients  were  sent 
the  explicit  guidelines,  which  were  con- 
cerned mainly  with  the  use  of  injections; 
some  physicians  also  were  involved  in  in- 
formal visits  with  the  reviewing 
physicians. 

During  its  4  years  of  operation,  the  em- 
phasis of  the  EMCRO's  ambulatory  care 
review  activity  was  on  injections.  In 
January  1972,  4  months  after  the  initiation 
of  the  peer  review  system,  educational  ef- 
forts were  started  among  physicians  who 
were  overusing  injections.  These  con- 
sisted mostly  of  informal  contacts  between 


11  Reviewing  physicians  numbered  over  a  hundred 
and  were  almost  always  practicing  physicians. 

**  Throughout  this  report,  we  will  refer  to  "services 
denied"  (e.g.,  injections  denied  for  medical  reasons); 
this  should  be  interpreted  as  meaning  that  payment 
for  those  services  was  denied  for  medical  reasons. 
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physicians  active  in  the  Foundation  and 
practicing  physicians  who  seemed  to  be 
giving  many  unnecessary  injections 
(mainly  osteopathic  physicians).  In  May 
1972,  the  formal  policy  regarding  use  of 
injections  was  adopted  by  the  Foundation 
and  disseminated  in  written  form  to  all 
physicians  participating  in  the  Medicaid 
program.  Thereafter,  denial  of  payment  for 
those  injections  given  for  medical  reasons 
not  meeting  the  guidelines  and  for  those 
injections  the  peer  review  physicians  felt 
were  medically  unnecessary  was  begun  in 
earnest.  (Some  denials  for  injections  based 
on  informal  medical  guidelines  had  begun 
in  September  1971.) 

The  specific  injection  guidelines  used 
for  clerical  and  peer  review  (Table  1.1) 
were  the  standards  used  as  of  1975  and 
represented  almost  exactly  the  same 
guidelines  adopted  in  1972.  The  injection 
guidelines  were  quite  specific.  For  exam- 
ple, vitamin  B12  was  allowable  only  in 
cases  of  pernicious  anemia,  iron  only  for 
severe  iron  deficiency  anemia  or  proven 
intolerance  to  oral  iron  and  estrogen  only 
in  the  event  of  intolerance  to  oral  estrogen; 
antibiotic  guidelines  emphasized  the  use 
of  long-acting  (LA)  penicillin  (penicillin  G 
benzathine)  in  streptococcal  infection  and 
discouraged  use  of  short-acting  (SA) 
penicillin  and  other  antibiotics.  Medicaid 
regulations  allowed  for  the  payment  of 
tetanus  and  DPT  boosters  only  in  situa- 
tions with  evidence  of  trauma  (e.g.  lacera- 
tions, burns).  Routine  immunizations  were 
not  covered  by  the  New  Mexico  Medicaid 
program  (because  they  were  given  in  pub- 
lic health  clinics)  and  were  denied  for 
administrative,  not  medical,  reasons. 
Influenza  vaccinations,  however,  were 
acceptable  for  all  patients  over  the  age  of  65 
and  for  patients  under  the  age  of  65  who 
had  severe  chronic  problems  in  which  in- 
fluenza could  be  a  serious  complication. 

Findings  of  the  First  2-Year  Study 

An  evaluation  of  the  New  Mexico 
E  MCRO  after  2  years  of  operation7  focused 


on  changes  in  the  use  of  injections  and  the 
relationship  between  inappropriate  use  of 
injections  and  selected  physician  charac- 
teristics believed  to  be  predictive  of  good 
quality  of  care.  Findings  of  that  study  are 
summarized  below,  to  provide  some  con- 
text for  the  present  study  and  the  empirical 
questions  we  chose  to  pursue  here. 

More  than  95,000  injections  were  ad- 
ministered to  the  Medicaid  population 
during  the  2-year  period;  of  these,  27,640 
(29  per  cent)  were  denied  for  medical  rea- 
sons. Close  to  50  per  cent  of  the  injections 
were  antibiotics;  about  one-quarter  of 
these,  on  average,  were  denied  for  medical 
reasons.  Of  the  other  major  categories  of 
injections  (e.g.,  antinauseants  and  an- 
tiemetics, steroids,  or  hormones),  between 
one-fifth  and  three-fifths,  on  average,  were 
denied  for  medical  reasons. 

Injections  in  the  2-year  period  were 
grouped  into  3  classes  depending  on  varia- 
tions over  time  in  the  number  billed  and 
the  number  denied  for  medical  reasons. 
For  an  injectable  drug  to  be  included  in 
Class  I,  2  criteria  had  to  be  met:  1)  a  sub- 
stantial drop  in  use  over  time;  and  2)  a  high 
percentage  of  denials  for  medical  reasons. 
Most  types  of  antibiotic  injections  were  in 
this  class  and  the  decline  in  their  use  was 
dramatic.  A  calculation  based  on  the  as- 
sumption that  no  decline  in  the  injection 
rate  would  have  occurred  in  the  absence  of 
the  E  MCRO  indicated  that  the  peer  review 
system  prevented  an  estimated  22,000  medi- 
cally unnecessary  antibiotic  injections  over 
the  2-year  period. 

Class  II  injections  included  10  types  of 
injectable  drugs  that  met  the  following  2 
criteria:  1)  little  or  no  change  in  the  physi- 
cian's use  of  injections;  and  2)  a  fairly  high 
percentage  of  denials  for  medical  reasons. 
For  these  injections,  neither  the  educa- 
tional efforts  nor  the  more  direct  sanctions 
were  as  successful  as  for  Class  I  injections 
and  they  were  highlighted  for  follow-up 
investigation. 

Injections  in  Class  III  met  1  of  2  criteria: 
1)  a  rise  in  the  number  of  injections  billed; 
or  2)  a  relatively  low  percentage  of  denials. 


4 


TABLE  1.1.    Present  Guidelines  for  Payment  or  Review  of  Specific 

Types  of  Injections 


I.  Specific  Standards  for  Appropriate  Injectables* 

1.  Vitamin  B12 

a.  One  injection  per  month  for  Vitamin  B12  deficiency  states  (i.e.,  pernicious  anemia,  or  malabsorption 
syndromes,  including  the  autonomic  neuropathy  sometimes  associated  with  diabetes). 

b.  Two  injections  within  one  2-week  period  for  severe  debilitation  (following  trauma,  severe  infections, 
operations,  acute  alcoholism).  This  will  occur  rarely  in  the  doctor's  office. 

2.  B-complex 

For  severe  nutritional  problems  where  the  patient  is  not  able  to  take  medication  by  mouth  or  where  there 
are  malabsorption  syndromes,  this  will  be  approved.  This  will  occur  rarely  in  the  doctor's  office. 

3.  Imferon — for  iron  deficiencies  where 

a.  Patient  has  demonstrated  intolerance  of  or  unresponsiveness  to  oral  iron. 

b.  Patient  needs  immediate  initiation  of  therapy  for  severe  iron  deficiency  anemia  (1  injection). 

4.  Gamma  globulin 

a.  For  prevention  or  modification  of  rubeola  or  infectious  hepatitis  where  direct  contact  has  been  proved. 

b.  Bruton-type  agammaglobulinemia. 

c.  In  certain  cases  using  special  immune  globulin  derived  from  sera  of  individuals  hyperimmunized  to  a 
specific  disease. 

5.  Antibiotics 

a.  Long  acting,  all  purpose  or  combination  respository,  containing  benzathine  penicillin  in  the  appropri- 
ate doses,  is  an  approved  method  of  treatment  in  patients  with  suspected  or  proven  Group  A  beta- 
hemolytic  streptococcal  conditions  such  as  strep  throat,  acute  tonsillitis,  acute  otitis  media,  acute 
sinusitis  or  acute  pharyngitis  (1  injection  per  illness  episode). 

b.  Erythromycin,  cephalosporin  or  lincomycin  when  patient  is  allergic  to  penicillin  in  streptococcal 
condition. 

c.  In  gonococcal  diseases,  penicillin  (or  ampicillin)  is  indicated  (spectinomycin  and  tetracycline,  in  that 
order,  if  allergic  to  penicillin). 

d.  In  syphilis,  penicillin  is  also  indicated  (erythromycin  and  tetracycline,  in  that  order,  if  allergic  to 
penicillin).  Multiple  injections  in  syphilis  are  indicated.  In  areas  where  there  are  public  health  clinics, 
however,  appropriate  injections  will  be  covered  (allowed  for  payment)  only  on  those  dates  of  service 
prior  to  the  first  day  that  clinic  services  are  available. 

6.  Injectable  expectorants  or  cough  medicines 
Never!  Example:  Gomenol 

7.  Estrogens 

Estrogens  for  menopausal  syndromes  will  be  covered  (allowed  for  payment)  only  when  the  patient  cannot 
take  the  drug  orally,  and  the  claim  documents  this  situation. 

8.  Influenza  vaccine 

a.  For  patients  over  65  years. 

b.  For  patients  under  65  years  who  are  severely  medically  debilitated  (e.g.,  severe  respiratory  or  cardiac 
problems). 

9.  The  use  of  ACTH  is  limited  to  diagnosis  (in  the  plasma  Cortisol  test  to  assess  adrenal  cortical  function)  or  in 
the  treatment  of  the  following  conditions: 

a.  Certain  cases  of  multiple  sclerosis. 

b.  Certain  cases  of  myasthenia  gravis. 

c.  Certain  cases  of  inflammatory  bowel  syndrome. 


*  These  are  standards  (as  revised  in  1973)  used  by  the  clerks  to  decide  if  injections  could  be  paid  without 
physician  review.  All  injections  not  meeting  these  criteria  were  reviewed  by  a  physician  to  determine  medical 
appropriateness. 
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TABLE  1.1  Continued. 


10.  Tetanus  Toxoid  and  DPT  boosters  are  medically  appropriate  and  may  be  paid  whenever  there  is  evidence 
of  a  trauma  such  as  a  laceration,  burn,  abrasion,  animal  bite,  puncture  wound,  etc. 

11.  Xylocaine,  Lidocaine,  Procaine,  and  Novacaine  are  medically  appropriate  if  a  necessity  for  local  anes- 
thesia is  indicated,  i.e.,  suturing,  needling,  etc. 

12.  Antiasthmatics 

The  following  injections  are  medically  appropriate  for  claims  with  a  diagnosis  of  asthma. 

a.  Epinephrine 

b.  Aminophylline 

c.  Susphrine 

d.  Adrenaline  and  oil 

13.  Antiemetics 

When  nausea  and  vomiting  is  indicated  on  the  claim  and  an  injection  is  given,  all  claims  must  be  reviewed 
by  a  physician.  The  drugs  listed  below  are  examples  of  injections  which  must  be  reviewed: 

a.  Compazine 

b.  Dramamine 

c.  Phenergan 

d.  Sparine 

e.  Tigan 

f.  Vistaril 

g.  Atarax 

14.  Myochrysine  and  Solganal  (Gold) 

Injections  of  myochrysine  and  solganal  for  juvenile  and  adult  rheumatoid  arthritis  are  medically  appropri- 
ate. These  injections  are  given  once  a  week  for  a  period  of  3  to  4  months.  After  this  initial  3-  to  4-month 
period,  these  injections  will  be  given  once  a  month.  Any  injections  falling  outside  these  guidelines  must 
be  sent  to  professional  review. 

15.  Dilantin  and  Phenobarbital 

Injections  of  dilantin  or  phenobarbital  are  medically  appropriate  if  the  diagnosis  is  epilepsy  or  seizures. 


The  most  important  finding  in  this  class  of 
injections  was  that  the  use  of  LA  penicillin 
doubled  during  the  2  years  and  was  ac- 
companied by  a  denial  rate  of  only  10  per 
cent.  When  an  injection  was  required  for 
streptococcal  infection,  LA  penicillin  was 
considered  by  New  Mexico  EMCRO 
physicians  to  be  the  therapy  of  choice. 
Evidently,  by  the  end  of  the  2  years,  it  was 
used  in  place  of  other  antibiotics  that  were 
either  potentially  more  dangerous  or  not 
the  antibiotic  of  choice  for  the  diagnosis. 
The  findings  about  Classes  I  and  III  sub- 
stantiated the  claim  that  the  peer  review 
system  improved  the  quality  of  medical 
care  for  this  population,  using  the  simple 
criterion  of  antibiotic  injection  use. 


On  the  whole,  the  data  demonstrated 
that  the  peer  review  system  functioned  ra- 
tionally and  consistently  in  accordance 
with  established  injection  policies.  It  re- 
duced the  use  of  injections  by  modifying 
physician  behavior  through  educational 
and  direct  sanction  activities.  It  changed 
the  administration  pattern  of  antibiotic  in- 
jections away  from  the  use  of  SA  penicillin 
and  other  antibiotics  to  LA  penicillin.  The 
questions  that  remained,  however,  in- 
cluded the  following:  for  what  had  these 
antibiotics  been  used  in  the  first  place  and 
what  differences  in  oral  drug  use,  if  any, 
did  the  changes  in  injections  make? 

The  2-year  study  included  analyses  to 
examine  the  relationship  between  physi- 
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cian  characteristics  and  use  of  injections. 
Three  dependent  variables  were  con- 
structed: 1)  number  of  injections  billed  per 
ambulatory  visit;  2)  number  of  injections 
for  which  payment  was  denied  for  medical 
reasons  per  ambulatory  visit;  and  3) 
number  of  injections  whose  payment  was 
denied  for  medical  reasons  per  number  of 
injections  billed  (i.e.,  injections  denied  for 
medical  reasons  as  a  percentage  of  in- 
jections billed).  The  major  explanatory  vari- 
ables for  physicians  in  solo  practice  were 
as  follows:  age  of  physician,  country  of 
medical  education  (U.S.  and  Canadian 
schools  versus  all  other  foreign  schools), 
specialty,  board  certification  status, ft 
rural/urban  location  of  practice,  type  of 
physician  (Doctor  of  Osteopathy  [DO]  or 
Doctor  of  Medicine  [MD]),  and  for  one 
analysis  only,  group  practice  versus  solo 
practice. 

DOs  had  a  higher  rate  of  medically  inap- 
propriate use  of  injections  than  MDs,  and 
noncertified  physicians  a  higher  rate  than 
certified.  Findings  on  physician  age  were 
equivocal;  quality  of  care  deteriorated  with 
age  for  DOs  but  not  MDs;  for  the  latter,  the 
poorest  care  was  given  by  the  youngest  and 
oldest  physicians.  Foreign  medical 
graduates  did  not  give  significantly  poorer 
care  than  U.S.  graduates.  Quality  of  care 
did  not  vary  systematically  with  practice 
location  (rural  versus  urban).  Results  with 
regard  to  specialty  were  mixed:  the  poorest 
care  was  given  by  obstetricians/ 
gynecologists,  and  the  best  care  by  pedia- 
tricians; general  practitioners  were  not 
markedly  different  from  internists.  Finally, 
partnerships,  groups  and  clinics  tended  to 


ft  The  distinction  was  between  board-certified 
physicians  and  all  other  noncertified  physicians.  The 
latter  category  included  physicians  who  were  "board 
eligible" — i.e.,  those  who  had  completed  a  sufficient 
number  of  years  of  training  to  qualify  to  take  the  board 
examination  or  had  taken  but  failed  the 
examination — and  physicians  who  were  not  board- 
eligible.  No  data  were  available  to  distinguish  among 
board-certified,  board-eligible,  and  noncertified 
physicians. 


provide  care  superior  to  that  provided  by 
any  class  of  solo  physicians. 

A  small  set  of  "outlier"  physicians 
emerged,  characterized  by  extremely  high 
rates  of  denial  of  payment  for  injections  for 
medical  reasons.  These  physicians  num- 
bered 15  MDs  and  7  DOs  (7  per  cent  of  the 
313  solo  physicians  who  provided  care  in  at 
least  100  visits  to  the  Medicaid  population 
in  the  2-year  study  period),  and  accounted 
for  more  than  40  per  cent  of  all  unnecessary 
injections  but  only  14  per  cent  of  all  am- 
bulatory visits.  Although  both  MDs  and 
DOs  were  involved  in  this  "outlier"  group, 
the  percentage  giving  inappropriate  in- 
jections was  higher  for  DOs  than  MDs.  No 
pediatricians  were  included  among  MD 
outliers,  and  no  internists,  pediatricians,  or 
surgeons  were  included  among  DO  out- 
liers. The  group  practice  category  had  no 
outliers.  In  the  present  4-year  study,  this 
same  set  of  22  physicians  has  been  labeled 
as  outlier  physicians. || 

All  physician  types  substantially  im- 
proved their  injection  practices  over  the 
2-year  period,  outliers  the  most.  Arguably, 
some  phenomenon  other  than  the  EMCRO 
might  have  produced  the  dramatic  fall  in 
injection  use,  but  this  seemed  unlikely  for 
at  least  2  reasons.  First,  with  respect  to 
ambulatory  care,  injections  were  given 
close  and  nearly  exclusive  scrutiny  by  the 
EMCRO  during  most  of  the  first  2  years  of 
operation.  Second,  use  of  all  other  am- 
bulatory services  increased  during  this  pe- 
riod (and  the  subsequent  2  years  as  well) 
while  injection  use  continued  to  fall.8  In 
particular,  use  of  prescription  drugs,  which 
were  not  subjected  to  medical  review  (and 
thus  served  as  a  control  for  some  external 
factors),  rose  by  about  14  per  cent  over  the 
1971-1975  period. 


tt  Because  identified  outliers  might  have  been 
dropped  from  the  Medicaid  lists  or  left  the  state,  we 
checked  whether  outliers  had  continued  delivering 
services  to  the  Medicaid  population.  All  but  1  pro- 
vided a  large  number  of  services  in  the  last  2  years  of 
the  study  (more  than  100  ambulatory  visits  in  2  years). 


7 


At  the  end  of  the  2-year  study,  the  per- 
manence of  the  changes  brought  about  by 
the  peer  review  system  was  unknown; 
hence,  investigation  of  the  full  4  years  of 
the  EMCRO's  operation  would  clarify 
whether  an  effect  of  this  nature  could  be 
maintained  over  a  longer  time  period.  This 
question  is  considered  in  Chapters  II  and 
III.  The  injections  guidelines  were  in  most 
instances  related  to  specific  diagnoses.  We 
wished  to  investigate,  therefore,  whether 
physicians  shifted  their  use  of  ambulatory 
diagnoses  over  time  to  justify  injections 
that  would  otherwise  be  disallowed.  This 
question  is  treated  in  Chapter  V.  Findings 
on  outlier  physicians  warranted  additional 
investigation,  especially  regarding 
whether  the  marked  improvement  in  their 
injection  practices  was  maintained.  This 
variable  was  retained  in  the  analyses  re- 
ported in  later  chapters. 

Finally,  because  higher  quality  of  care 
may  represent  more  expensive  care,  and 
because  the  observed  decrease  in  the  use 
of  injections  might  be  associated  with 
greater  numbers  of  other  services  (pre- 
scriptions, office  visits  or  laboratory  tests), 
we  examined  these  relationships  through 
the  episode-of-care  analyses  described  in 
Chapter  VI.  Furthermore,  the  single 
quality-of-care  criterion — namely,  use  of 
inappropriate  injections — did  distinguish 
among  physician  types  and  did  isolate  out- 
lier physicians.  To  determine  whether  it 
would  correctly  predict  poor  quality  of  care 
using  a  broader  spectrum  of  process 
criteria,  the  episode  analyses  reported  in 
Chapter  VI  employed  criteria  encompass- 
ing several  major  facets  of  ambulatory  care 
that  could  be  evaluated  with  claims  data 
(frequency  of  office  visits,  diagnostic  pro- 


cedures, and  oral  and  injectable 
medications). 

Methodologic  Notes 

The  analyses  reported  in  Chapters  II 
through  VI  have  certain  elements  in  com- 
mon. First,  some  analyses  were  done  on  a 
"before"  and  "after"  basis.  Period  I  is  de- 
fined as  the  5  months  preceding  dissemina- 
tion of  EMCRO  injection  guidelines,  i.e., 
September  1971  to  January  1972.  Period  II 
is  September  1973  to  January  1974,  after 
most  of  the  effect  of  the  EMCRO  on  reduc- 
ing injection  use  had  been  achieved.  Un- 
less otherwise  noted,  Periods  I  and  II  refer 
to  these  time  frames  throughout  this  re- 
port.^ Some  analyses  refer  to  the  "end  of 
the  study,"  which  was  defined  as  a 
5-month  period  at  the  end  of  the  fourth  year 
(April-August  1975). 

Second,  the  analyses  were  based  either 
on  the  entire  Medicaid  population  (irre- 
spective of  the  length  of  enrollment)  or  on 
an  AFDC  cohort  that  had  been  enrolled  in 
Medicaid  continuously  for  4  years.  This 
cohort  was  selected  for  several  reasons:  1) 
because  it  was  relatively  healthy, 
diagnosis-specific  analyses  were  less  con- 
founded by  the  presence  of  underlying 
chronic  diseases;  2)  no  Medicaid- 
Medicare  "crossover"  problems  would  be 
encountered;  3)  it  made  up  the  largest  frac- 
tion of  the  Medicaid  population;  and  4)  no 
enrollee  characteristic  changed  in  this 
cohort  except  aging  over  the  4-year  period. 

§§  For  methodologic  reasons,  Periods  I  and  II  actu- 
ally cover  6-month  periods  (September-February)  in 
the  episode  analyses  reported  in  Chapter  VI.  This 
slight  modification  does  not  affect  the  interpretation 
or  conclusions  in  any  material  way. 


8 


II.  Use  of  Selected  Types  of  Injections 


Thirty-eight  pharmacologic  groups  of 
injections  were  specified  for  the  4-year  in- 
jection analyses  (Table  2.1).  Injections 
were  assigned,  if  possible,  to  1  of  37 
specific  groups,  depending  on  phar- 
macologic action,  indications  for  use  and 
other  information  contained  in  various 
drug  manuals  and  formularies  (such  as  the 
Physician's  Desk  Reference  and  the  AMA 
National  Drug  Code).  The  residual  (38th) 
"all  other  injections"  group  was  less  than  5 
per  cent  of  all  injections  billed.  Some 
groups  were  single  examples  of  a  broader 
type  of  drug  (e.g.,  short- acting  [  S  A]  penicil- 
lin as  a  separate  antibiotic);  others  were 
more  aggregated  groups  (e.g.,  anti- 
nauseants/antiemetics  or  diuretics);  still 
others  were  single  entities  that  were  not 
subsets  of  any  broader  type  of  drug  under 
study  (e.g.,  vitamin  B12). 

Injections  Billed 

Of  all  injections  billed  (Table  2.1),  about 
half  were  antibiotics,  chiefly  SA  and  LA 
penicillin.*  The  next  largest  group  of  injec- 
tions billed  was  immunizations.  Other 
large  groups  included  tranquilizers, 
analgesics  and  steroids.  The  number  of  in- 
jections billed  per  100  eligibles  (Fig.  2.1a) 
or  per  100  ambulatory  visits  (Fig.  2.1b)  de- 
creased substantially  over  time,  with  the 
greatest  drop  between  the  first  and  second 
years.  Simple  regression  analyses  indi- 
cated that  the  number  of  injections  billed 
per  Medicaid  eligible  decreased  75  per 
cent  and  per  AFDC  eligible,  74  per  cent. 
Similarly,  the  number  of  injections  billed 
per  ambulatory  visit  was  estimated  to  have 


*  Henceforth,  for  injectable  drugs,  SA  penicillin 
means  penicillin  G  potassium  or  sodium  and  penicil- 
lin G  procaine  alone.  Long-acting  (LA)  penicillin  is 
penicillin  G  benzathine. 


dropped  71  per  cent  for  the  total  Medicaid 
population  and  76  per  cent  for  AFDC.H 

Injections  Denied 

The  largest  group  of  injections  denied 
for  medical  reasons  (Table  2.1)  was  anti- 
biotics (46  per  cent  of  all  injections  de- 
nied). The  next  largest  groups  were  ste- 
roids, hormones,  vitamin  Bi2,  tranquilizers, 
analgesics,  and  all  other  injections. 

Denial  rates  were  quite  low  in  Period  I, 
reflecting  start-up  activities  and  the  fact 
that  large-scale  denial  of  payments  did  not 
begin  until  late  in  the  first  year  after  the 
formal  injection  policy  had  been  adopted 
(Figs.  2.1a,  b).  The  percentage  of  injections 
denied  with  respect  to  the  total  billed  rose 
from  21  per  cent  to  44  per  cent  in  the  first  2 
years  and  then  dropped  to  20  per  cent  in 
the  fourth  year. 

Population  Rates  of  Use 

Overall,  injections  billed  per  eligible 
and  per  ambulatory  visit  decreased  con- 
siderably between  the  beginning  and  end 
of  the  study — from  8.2  to  3.2  injections  per 
100  eligibles  per  month.  Initially,  approx- 
imately 1  in  12  Medicaid  eligibles  per 
month  had  1  injection;  4  years  later,  about  1 
in  31  eligibles  per  month  was  receiving  an 
injection.  At  both  the  start  and  finish  of  the 
study,  around  20  per  cent  of  all  injections 
were  being  denied  for  medical  reasons. 


t  The  regression  equations  took  the  form  of  Y  =  a  + 
bjXj  +  b^Xz  +  error,  where  Y=  the  number  of  injec- 
tions billed  per  100  eligibles,  X!  =  the  month  (scored 
from  1  to  48),  and  =  a  dummy  variable  for  winter 
(December,  January,  February).  The  equations  for  in- 
jections billed  per  eligible  explained  72  per  cent  of 
the  variance  for  all  Medicaid  eligibles  and  62  per  cent 
for  AFDC  eligibles  (p  <  0.001).  The  equations  per 
ambulatory  visit  explained  75  and  72  per  cent,  respec- 
tively (p  <  0.001). 
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Table  2.1.    Total  Number  of  Injections  Billed  by  Pharmacologic  Type  of  Injection, 
New  Mexico  Medicaid  Program  September  1971  to  August  1975 


Injections  Billed         Injections  Denied  for  Medical  Reasons 


Per  Cent  of  Per  Cent  of 

Type  of  Injection  Number  Total  Number      Per  Cent    Number  Billed 


Antibiotics  79,510 

SA  Penicillin*  31,100 

Lincomycin  10,769 

Ampicillin  2,824 

Tetracycline  4,462 

LA  penicillin*  27,243 

Other  antibiotics  1,248 
Antibiotic- Antibiotic 

combinations  375 
Antibiotic-nonantibiotic 

combinations  1,489 

Antihistamines  3,998 

Phenergan  2,006 

Other  1,992 

Antinauseant-antiemetics  2,756 

Compazine  3,317 

Tranquilizers  11,369 

Hydroxyzine  4,190 

Diazepam/chlordiazepoxide  2,933 

Thorazine/promazine  4,246 

Steroids  8,792 

Decadron  2,020 

Kenalog  1,382 

Depo-Medrol  1,741 

Other  3,649 

ACTH  2,841 

Hormones  5,511 

Estrogen  3,748 

Progesterone  1,273 

Testosterone  490 

Analgesics  9,354 

Narcotic  6,929 

Non-narcotic  2,425 

Synthetic  Antispasmodics  1,157 

Immunizations  13,398 

DPT  3,390 

Tetanus  6,305 

Influenza  2,130 

Other  1,573 

Allergens  and  Asthma  Drugs  6,848 

Gamma  Globulin  1,925 

Vitamin  B^  4,565 

Iron  705 

Diuretics  1,046 

Expectorants  1,153 

Gold  1,575 

All  Other  Injections  7,873 

Total  167,693 


47.4 

19,613 

45.5 

24.7 

8,993 

28.9 

3,614 

33.6 

861 

30.5 

2,063 

46.2 

2,889 

10.6 

509 

40.8 

149 

39.7 

535 

35.9 

2.4 

1,302 

3.0 

32.6 

522 

26.0 

780 

39.2 

1.6 

414 

1.0 

15.0 

2.0 

436 

1.0 

13.1 

6.8 

2,759 

6.4 

24.3 

1,377 

32.9 

748 

25.5 

634 

14.9 

5.2 

3,279 

7.6 

37.3 

690 

34.2 

425 

30.8 

583 

33.5 

1,581 

43.3 

1.7 

1,850 

4.3 

65.1 

3.3 

3,180 

7.4 

57.7 

2,493 

66.5 

411 

32.3 

276 

56.3 

o.o 

O.o 

9fi  7 

i,Doy 

99  K 

949 

38.8 

0.7 

188 

0.4 

16.2 

8.0 

141 

0.3 

1.1 

20 

0.6 

40 

0.6 

65 

3.1 

16 

1.0 

4.1 

124 

0.3 

1.8 

1.1 

107 

0.2 

5.6 

2.7 

3,174 

7.4 

69.5 

0.4 

259 

0.6 

36.7 

0.6 

406 

0.9 

38.8 

0.7 

816 

1.9 

70.8 

0.9 

33 

0.1 

2.1 

4.7 

2,494 

5.8 

31.7 

100.0 

43,076 

100.0 

25.7 

*  SA  is  short-acting  penicillin  (penicillin  G  potassium  or  sodium  and  penicillin  G  procaine  alone).  LA  is 
long-acting  penicillin  (penicillin  G  benzathine). 
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Figs.  2.1A  (top)  and  2.1B 
(bottom).  The  upper  graph 
depicts  the  total  number  of 
injections  billed  and  de- 
nied for  medical  reasons 
per  100  Medicaid  eligibles 
for  the  years  1971-1975; 
the  lower  graph  displays 
the  total  number  of  in- 
jections billed  and  denied 
for  medical  reasons  per  100 
ambulatory  visits  for  the 
same  period. 


-  Injections  Billed 

-  Injections  Denied  for  Medical  Reasons 


Medical  Reasons 
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TIME  IN  MONTHS 


3  5 
1975 


Thus,  at  least  1  in  156  eligibles  per  month 
was  still  receiving  a  medically  inappropri- 
ate injection  toward  the  last  part  of  the 
study. 


Assuming  only  1  injection  per  outpatient 
service  (which  is  an  underestimate),  more 
than  37  per  cent  of  all  ambulatory  visits  (or 
1  in  every  2.6  visits)  ended  with  an  injec- 
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TABLE  2.2    Rates  of  Use  and  of  Denial  of  Payment  for  Class  I  Injections 


Denial-of- Payment 

Rate  During  Initial  Rate  of  Use:t 

Early  Period   

of  Enforcement  High                            Medium  Low 

of  Guidelines*  (Above  0.50)                     (0.20-0.50)                          (Below  0.20) 


Very  high  (above  70%) 


High  (50-70%; 


Medium  (30-50%) 


Low  (10-30%; 


Lincomycin 
Tetracycline 
ACTH 
Vitamin  B]2 

Other  steroids 


SA  Penicillin 


Estrogen 


Antibiotic/ nonanti- 

biotic  combination 
Diuretics 


Ampicillin 

All  other  injections 


Expectorants 


Testosterone 
Antibiotic/anti- 
biotic combinations 
Other  antibiotics 
Iron 

Depo-Medrol 

Nonnarcotic  analgesics 

Decadron 

Kenalog 

Progesterone 

Synthetic  anti- 
spasmodics 
Compazine 


*  Classification  determined  by  the  denial  rate  for  half  or  more  of  the  months  between  January  1972  and 
August  1973,  inclusive. 

f  Classification  determined  by  the  number  of  injections  billed  per  lOOeligibles  in  at  least  1  month  of  the  first 
year  of  the  study. 


tion  initially;  at  the  end,  the  figure  was 
about  17  per  cent  (or  just  under  1  in  6  vis- 
its). With  the  20  per  cent  denial  rate  at  the 
end  of  the  study,  about  1  in  30  visits  still 
ended  in  an  inappropriate  injection. 

Classes  of  Injections 

The  EMCRO's  diagnosis-specific 
guidelines  for  use  of  injections  had  the 
clear  intention  of  severely  reducing  use  of 
some  injections  and  permitting  or  en- 
couraging the  use  of  a  limited  number  of 
other  injections.  To  examine  the  EM- 
CRO's effect  on  injection  use  across  the 
pharmacologic  groups,  the  38  types  of  in- 
jections were  categorized  into  3  classes, 
depending  on  variations  in  the  number 
billed  and  denied  over  time. 

Class  I 

Class  I  injections  (Table  2.2)  were  de- 
fined as  those  injections  whose  use  de- 


creased substantially  over  the  4  years;  they 
were  further  classified  according  to 
whether  the  initial  level  of  use  was  high, 
medium  or  low.|  With  some  exceptions, 
denial  rates  for  these  types  of  injections 
were  quite  high  early  in  the  study  (e.g., 
more  then  50  per  cent  denials  for  at  least 
half  of  the  injections  in  this  class).  Denial 
rates  tended  to  stay  comparatively  high  for 
many  injections  in  this  class  (although 
based  at  the  end  of  the  study  on  very  small 
numbers  of  injections).  Twenty-three  of 
the  38  types  of  injections  were  categorized 
in  Class  I. 

Use  of  certain  antibiotics  (SA  penicillin, 
lincomycin,  tetracycline,  and  ampicillin) 
decreased  significantly  over  the  4-year  pe- 


\  High  use  was  defined  as  more  than  0.50  injections 
billed  per  100  eligibles  per  month  in  at  least  1  month 
of  the  first  year  of  the  study  (typically  within  the  first  5 
months),  medium  use  as  0.20  to  0.50  injections  per  100 
eligibles,  and  low  as  below  0.20  injections  per  100 
eligibles. 
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Figs.  2.2A  (top)  and  2.2B 
(bottom).  The  upper  graph 
depicts  the  number  of  tet- 
racycline injections  billed 
and  denied  for  medical  rea- 
sons per  100  Medicaid  elig- 
ibles  for  the  years  1971- 
1975;  the  lower  graph  dis- 
plays the  number  of  estro- 
gen injections  billed  and 
denied  for  medical  reasons 
per  100  Medicaid  eligibles 
for  the  same  period. 
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riod.  The  use  of  SA  penicillin  was  mark- 
edly curtailed  in  line  with  EMCRO 
quality-of-care  intentions;  injectable  lin- 
comycin,  ampicillin  and  tetracycline  were 
virtually  eliminated.  Tetracycline  (Fig. 
2.2a)  was  a  dramatic  example. 


The  use  of  several  other  injections  de- 
creased substantially  over  the  4-year  period, 
including  steroids  (other  than  Decadron, 
Kenalog,  or  Depo-medrol)  and  ACTH.  The 
use  of  nearly  all  these  injections  began  to 
decline  by  mid- 1972  (i.e.,  within  the  first 
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year  following  peer  review);  vitamin  B12 
remained  high  for  2  years  before  declining. 

The  remaining  injections  in  Class  I  had 
started  at  moderate  to  low  levels  of  use; 
consequently,  the  declines  were  not  as  im- 
pressive as  with  the  antibiotics.  These  in- 
jections included  diuretics,  the  remaining 
steroids,  hormones,  synthetic  anti- 
spasmodics, iron,  compazine,  and  all  other 
injections.  Estrogen  was  a  typical  example 
(Fig.  2.2b).  Again,  most  of  these  injections 
began  to  decline  soon  after  the  promulga- 
tion of  the  injection  guidelines  in  1972. 

Class  II 

The  second  class  of  injections  (Table  2.3) 
included  6  pharmacologic  types  for  which 
the  number  of  injections  billed  either 
dropped  only  a  little  over  the  4-year  period 
or  appeared  to  have  a  very  steady  rate  of 
use  over  time.  These  included  Phenergan, 
other  antihistamines,  certain  tranquilizers, 
and  antinauseants/antiemetics.  Narcotic 
analgesics  (Fig.  2.3)  were  illustrative. 

Denial  rates  for  this  class  were  generally 
moderate  to  high  in  the  early  part  of  the 


Table  2.3.    Rates  of  Use  and  of  Denial 
of  Payment  for  Class  II  Injections 


Denial -oi- Payment 

Rate  During 

Early  Period 

Initial  Rate  oi 

nt  17  t"i  t<^  yc*    m  pnt 
\>i  i— jimjiHriilfcrlll 

I  1  c  a  •  T     1  mir 
KJ  3C  .  J  LiUW 

Ui  v_y  Uivlcll 1 1  tr o 

High  (50-70%) 

Other  antihistamines 

Medium  (30-50%) 

Hydroxyzine 

Diazepam 

Narcotic  analgesics 

Low  (10-30%) 

Phenergan 

Antinauseants/anti- 

emetics 

*  See  note,  Table  2.2. 

t  See  note,  Table  2.2.  Use  of  narcotic  analgesics 
occasionally  rose  slightly  above  this  threshold  level. 


study  but  (with  the  exception  of  hy- 
droxyzine) dropped  to  fairly  low  levels 
over  the  latter  part  of  the  study.  This  class 
thus  seemed  to  represent  drugs  that  were 
used  for  a  broad  spectrum  of  conditions 
and  that  either  were  used  with  reasonable 
propriety  and  caution  by  the  end  of  the 
study  or  were  resistant  to  all  efforts  of  the 
peer  review  system  to  bring  about  change. 


•  26r 
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Fig.  2.3.  Number  of 
narcotic  analgesics  in- 
jections billed  and  denied 
for  medical  reasons  per 
100  Medicaid  eligibles, 
1971-1975. 
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Table  2.4.    Rates  of  Use  and  of  Denial  of  Payment  for  Class  III  Injections 


Denial-of-Payment 

Rate  During  Rate  of  Use  after  4  Years'  Enforcement! 

Early  Period   

of  Enforcement  High                              Medium  Low 

of  Guidelines*  (Above  0.50)                      (0.20-0.50)                       (Below  0.20) 


Medium  (30-50%) 

Low  (10-30%) 

Very  low  (Below  10%) 


LA  Penicillin} 


Thorazine} 


Allergens/asthma 
drugs} 


Influenza} 
DPT} 
Tetanus§ 
Other  immu- 
nizations § 
Gamma  globulin§ 
Gold§ 


*  See  note,  Table  2.2. 

t  Classification  determined  by  average  number  of  injections  billed  per  100  eligibles  per  month  in  the  last 
year  of  the  study. 

}  Showed  a  rise  in  use  over  the  4  years. 

§  Showed  no  change  in  use  over  the  4  years. 


Class  III 

The  third  class  of  injections  (Table  2.4) 
comprised  the  9  types  of  injections  for 
which  the  number  billed  per  100  eligibles 
either  rose  over  4  years  (together  with  low 
denial  rates)  or  was  comparatively  steady 
(but  with  extremely  low  denial  rates).  With 
the  exception  of  chlorpromazine  hy- 
drochloride (Thorazine)  (discussed  be- 
low), denial  rates  for  the  Class  III  injec- 
tions were  all  quite  low  over  the  entire 
period.  In  short,  this  represents  a  class  of 
injections  that  in  general  were  used  appro- 
priately throughout  the  study. 

In  contrast  to  all  the  other  antibiotics 
(discussed  in  Class  I  above),  use  of  LA 
penicillin  (Fig.  2.4)  rose  over  time;  not  un- 
expectedly, it  also  showed  a  marked 
(winter)  seasonality.  Other  injections 
whose  use  rose  over  time  were  2  types  of 
immunizations  §  (influenza  and  DPT 
boosters)  and  allergens/asthma  drugs. 


§  DPT  as  a  common  periodic  immunization  for 
children  is  not  covered  by  the  New  Mexico  Medicaid 
program,  because  those  immunizations  are  provided 
free  of  charge  through  another  agency.  DPT  injections 
are  allowed  as  tetanus  boosters,  however. 


Use  of  the  remaining  immunizations 
(tetanus,  gamma  globulin  and  other  im- 
munizations) and  gold  appeared  to  be 
quite  steady  over  time,  which  would  seem 
to  place  them  in  Class  II.  Their  denial 
rates,  however,  were  so  much  lower  than 
those  for  the  Class  II  injection  groups  that 
they  were  felt  to  belong  more  properly  to 
Class  III. 

Thorazine  had  a  unique  pattern.  Early  in 
the  study,  it  had  quite  low  levels  of  use  and 
moderately  high  denial  rates.  Between  the 
second  and  fourth  years,  however,  the  rate 
of  injections  given  per  100  eligibles  per 
month  went  from  0.06  to  0.16,  and  its  use 
remained  comparatively  high  for  the  re- 
mainder of  the  study.  Moreover,  the  denial 
rate  declined  somewhat  at  the  same  time. 
The  explanation  for  this  rise  in  the  use  of 
Thorazine  is  unclear. 

Discussion 

Based  on  these  data,  the  following  con- 
clusions were  drawn  about  the  effect  of  the 
EMCRO  over  the  4  years  of  its  operations. 

1.  Use  of  injections  in  toto  dropped 
more  than  70  per  cent  between  the  start 
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and  end  of  EMCRO  activities.  This  effect 
was  mostly  achieved  within  2  years  of  the 
beginning  of  active  review,  since  the  use  of 
injections  per  Medicaid  eligible  had  drop- 
ped an  estimated  60  per  cent  by  the  end  of 
2  years. 

2.  Substantial  declines  in  use  were 
achieved  for  a  wide  variety  of  injections. 
The  greatest  declines  were  among  those 
injections  with  potentially  more  serious 
side  effects,  those  widi  more  specific  indi- 
cations for  use,  and  those  that  were  abused 
the  most  when  the  EMCRO  program  first 
began. 

3.  Declines  were  generally  sustained; 
subsequent  rises  in  use  among  injection 
types  that  initially  had  been  curtailed  dras- 
tically were  slight  or  nonexistent. 

4.  A  nontrivial  amount  of  inappropriate 
injection  treatment  was  observed  even  at 
the  end  of  the  study;  more  than  20  per  cent 
of  all  injections  were  still  being  denied  for 
medical  reasons  at  the  start  of  the  fourth 
year  and  about  16  per  cent  at  the  end  of  that 
year.  The  implication  seemed  to  be  that  at 
least  some  physicians  will  continue  to  give 
certain  types  of  injections  even  when  they 
have  every  reason  to  expect  they  will  not 


be  reimbursed  for  them.  The  types  of  injec- 
tions that  seemed  to  fall  into  this  category 
included  SA  penicillin,  antihistamines, 
hydroxyzine,  steroids  and  hormones. 

5.  These  changes  in  use  of  injectable 
drugs — especially  potent  agents  such  as 
the  antibiotics — were  considered  a  clini- 
cally important  improvement  in  the  quality 
of  ambulatory  care  because  of  the  side  ef- 
fects and  iatrogenic  problems  avoided  and 
because  the  overall  care  provided  came 
more  into  line  with  accepted  criteria. 

We  drew  several  implications  for  quality 
assurance  programs  from  these  findings. 
First,  given  that  a  quality-of-care  problem 
is  identified  and  a  decision  made  to  at- 
tempt to  correct  it,  PSROs  should  be  able  to 
make  major  progress  on  the  problem 
within  a  fairly  short  period  (e.g.,  2  years  or 
so).  Second,  100  per  cent  (i.e.,  case-by- 
case)  review  is  probably  unnecessary  after 
the  major  part  of  a  problem  has  been  cor- 
rected; with  respect  to  injections  in  New 
Mexico,  this  was  certainly  true  after  3  years 
of  peer  review.  Thus,  the  effect  of  a  peer 
review  system  can  probably  be  maintained 
with  substantially  less  expenditure  of  time 
and  resources  once  the  major  lessons  have 


 Injections  Billed 

 Injections  Denied  for  Medical  Reasons 


Fig.  2.4.  Number  of  in- 
jections of  long-acting 
penicillin  billed  and  de- 
nied for  medical  reasons 
per  100  Medicaideligibles, 
1971-1975. 


TIME  IN  MONTHS 
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been  learned,  and  the  quality  assurance 
program  can  turn  from  case-by-case  review 
(or  prepayment  review)  to  more  cost- 
effective  sampling  techniques  (or  retro- 
spective review). 

Third,  the  2-part  mechanism  by  which 
the  EMCRO  successfully  modified  injec- 
tion use  deserves  further  study;  it  involved 
developing  guidelines  and  carrying  out 
educational  efforts  directed  at  physicians 
whose  practice  patterns  apparently  con- 
flicted most  with  those  guidelines,  fol- 
lowed several  months  later  by  sanctions  in 
the  form  of  denials  of  payment  for  inappro- 
priate injections.  This  approach  was  under- 
taken in  New  Mexico  partly  in  response  to 
the  serious  abuse  of  injections  recognized 
by  many  physician  leaders,  and  hence  the 
circumstances  may  have  favored  success- 
ful implementation.  Although  an  approach 
relying  in  the  first  instance  on  educational 
interventions  is  not  automatically  transfer- 
able to  other  types  of  services  (or  to  other 
peer  review  systems,  for  that  matter),  at- 
tempts to  extend  it  would  seem  to  be 
warranted. 

Some  of  these  conclusions  seem  to  have 
been  borne  out  by  subsequent  events.  The 
EMCRO  became  a  conditional  PSRO  in 
November  1974  and  maintained  the  re- 
view system  described  in  Chapter  I 
through  August  1975.  Thereafter,  a  new 
system  for  ambulatory  care  review  began, 
as  described  in  Ryland  et  al.74  It  included 
features  such  as  precoded  (specialty- 
specific)  claim  forms  for  physicians  who 
were  quite  active  in  the  Medicaid  program. 
More  to  the  point,  it  contained  a  sampling 
or  focused  approach  to  review  of  ambula- 
tory care.  This  was  possible  in  part  because 
of  the  extensive  and  virtually  complete 
computerized  data  files  on  patients  and 
physicians  that  were  maintained  by  The 
Dikewood  Corporation  (the  EMCRO  fiscal 
intermediary  up  to  that  time). 

The  first  component  of  the  new  review 
system  was  retrospective  review  of  all 
physicians  with  10  or  more  patient  encoun- 


ters for  a  given  diagnosis  during  a  6-month 
period.  The  review  could  focus  on  one  or  a 
combination  of  elements  of  those  encoun- 
ters (such  as  laboratory  tests,  injections, 
prescriptions,  roentgenography,  outpa- 
tient surgical  procedures  or  other  diagnos- 
tic procedures).  Through  3  "levels"  of  re- 
ports, specific  treatment  patterns  could  be 
examined.  Reports  could  divide  physi- 
cians into  3  statistical  distributions  (10th, 
50th  and  90th  percentiles)  or  focus  on  care 
given  to  individual  patients,  and  typically 
were  used  to  identify  anomalies  that 
needed  to  be  referred  to  the  Ambulatory 
Care  or  Education  Committees  of  the 
PSRO.  (With  the  change  of  fiscal  agent  in 
October  1977,  however,  these  statistical 
profiles  were  abolished.  New  retrospec- 
tive review  capabilities  were  expected  to 
be  devised.) 

Based  on  these  reports,  if  a  clerical  re- 
viewer decided  that  peer  review  of  the 
physician  profile  was  necessary,  then  the 
profile  was  forwarded  to  a  reviewing 
physician,  who  had  a  number  of  options, 
including  referring  the  material  about  a 
physician  to  either  an  Ambulatory  Care 
Committee  (if  the  problem  appeared  to  be 
one  of  utilization)  or  an  Education  Com- 
mittee (if  the  problem  was  more  one  of 
quality).  Some  of  these  activities  have  been 
evaluated.28,29 

The  second  component  of  the  review 
system  was  100  per  cent  prepayment  re- 
view of  claims  submitted  by  approximately 
10  per  cent  of  Medicaid  physicians  who 
had  been  identified  as  providing  in- 
adequate or  excessive  care.  This  approach 
had  the  effect  of  focusing  only  on  physi- 
cians and  not  on  problems  or  diagnoses; 
hence,  if  only  10  per  cent  of  the  services  of 
a  physician  on  prepayment  review  were 
questionable,  the  other  90  per  cent  were 
also  (perhaps  unnecessarily)  reviewed. 
This  is  an  inefficient  approach  that  could 
lead  to  inconsistencies,  if  not  inequities, 
because  these  latter  services — compared 
with  equivalent  services  of  physicians  not 
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on  prepayment  review — were  more  likely 
to  be  denied  simply  by  virtue  of  being 
reviewed. 

This  sampling  review  system  became 
operational  in  February  1976,  and  con- 
tinued until  roughly  October  1977,  when 
the  state  Medicaid  program  changed  fiscal 
intermediaries.  During  that  time,  between 
60  and  70  physicians  had  been  on  100  per 
cent  prepayment  review. 

Finally,  between  October  1976  and 
1978,  the  New  Mexico  PSRO  was  1  of  5 
ambulatory  care  review  demonstration 
projects  funded  by  the  Health  Standards 
and  Quality  Bureau,  Health  Care  Financ- 
ing Administration,  Department  of  Health, 


Education,  and  Welfare.  Among  other 
tasks,  the  PSRO  did  several  research  proj- 
ects focused  on  identifying  and  correcting 
problems  of  contraindicated  treatments 
and  modifying  physician  behavior  through 
education.  Both  activities  were  success- 
fully carried  out  with  the  claims-based 
computerized  data  set  using  physician/ 
patient/treatment  profiles  to  isolate  impor- 
tant problems  and  to  identify  physicians 
needing  further  intervention.29  Interest- 
ingly, the  change  in  fiscal  intermediary 
(because  of  financial  considerations,  not 
performance)  was  noted  to  be  "disruptive 
to  the  point  that  success  was  threatened  in 
every  major  area  of  Project  activity."29 
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III.  Physician  Characteristics  and  Appropriate  Use 

of  Injections 


The  second  phase  of  this  study  con- 
cerned how  different  types  of  physicians 
used  injections.  During  the  4-year  study, 
an  average  of  about  84,520  persons  per 
month  were  eligible  for  Medicaid  services. 
They  received  a  total  of  749,800  ambula- 
tory visits  and  167,690  injections.  These 
services  were  associated  with  a  total  of 
1,483  medical  providers  (i.e.,  different 
provider  numbers).  Of  these,  1,155  were 
MDs,  150  were  DOs,  177  were  group  prac- 
tices, and  1  was  a  dummy  provider  number 
assigned  to  all  services  billed  for  which  no 
referring  physician  was  known. 

We  restricted  our  analyses  to  358  "ac- 
tive" Medicaid  physicians,  i.e.  those  who 
billed  at  least  100  ambulatory  visits  in  the 
first  2  years  of  the  study.  This  was  done  to 
focus  the  analysis  on  physicians  who  were 
at  least  minimally  active  in  the  Medicaid 
program  and  who  thus  were  likely  to  be 
exposed  to  and  affected  by  the  peer  review 
system.  They  included  232  MDs  in  solo 
practice,  81  DOs  in  solo  practice,  38  group 
practices  (all  but  1  were  MD  groups)  and  7 
facilities  with  no  resident  physician.  The 
group  practices  varied  widely  and  in- 
cluded 2  large  multi specialty  groups  and 
several  small  single-specialty  clinics. 
Paramedical  professionals  staffed  full-time 
the  7  facilities  with  no  resident  physician. 
Physicians  attended  these  facilities  on  a 
rotating  basis;  they  were  usually  board- 
certified  physicians  from  larger  facilities  in 
more  urbanized  areas.  These  358  provid- 
ers, approximately  one-quarter  of  all  pro- 
viders delivering  services  to  the  Medicaid 
population,  accounted  for  almost  626,080 
ambulatory  visits  (84  per  cent  of  those 
matched  to  a  provider  number),  almost 
126,300  injections  billed  (75  per  cent  of 
those  matched),  and  almost  34,530  injec- 
tions denied  (80  per  cent  of  those 
matched). 


Aggregate  Use  of  Visits  and  Injections 
Type  of  Practice  and  Provider 

Physicians  in  solo  practices  provided 
most  of  the  ambulatory  visits;  they  ac- 
counted for  even  larger  proportions  of  in- 
jections billed  and  (especially)  denied 
(Table  3. 1).  MDs  in  solo  practice  accounted 
for  40  per  cent  of  the  total  number  of  ambu- 
latory visits,  38  per  cent  of  the  injections 
billed,  and  41  per  cent  of  the  injections 
denied.  For  the  DO  solo  providers,  the 
figures  were  33,  46  and  48  per  cent, 
respectively. 

Board  Certification  Status 

Board-certified  providers,  including 
both  solo  practitioners  and  group  practices, 
provided  34  per  cent  of  the  ambulatory  vis- 
its, 21  per  cent  of  the  injections  billed  and 
11  per  cent  of  the  injections  denied  (Table 
3.2).  For  noncertified  physicians,  the  fig- 
ures were  60,  71  and  77  per  cent,  respec- 
tively. The  remaining  services  were  given 
by  28  providers  on  whom  board  certifica- 
tion status  was  unknown.  Because  data  on 
provider  characteristics  were  obtained 
from  several  sources,  including  profes- 
sional associations,  most  if  not  all  of  the 
unknown  providers  were  probably  not 
board  certified. 

Board-certified  solo  practitioners  ac- 
counted for  16  per  cent  of  the  visits  but 
only  8  per  cent  of  the  denied  injections, 
whereas  noncertified  solo  practitioners  ac- 
counted for  56  per  cent  of  the  visits  and  74 
per  cent  of  the  denied  injections.  Among 
the  group  practices,  the  pattern  was  some- 
what different;  board-certified  groups  ac- 
counted for  18  per  cent  of  the  visits  but 
only  3  per  cent  of  the  denied  injections, 
whereas  noncertified  groups  accounted  for 
4  per  cent  of  the  visits  and  3  per  cent  of  the 
denied  injections. 
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Table  3.1.    Distribution  of  Services  by  Type  of  Practice  and  Provider 


Type  of  Practice 
and  Provider 

Number  of 
Providers 

Ambulatory  Visits 

Injections 

Billed 

Injections  Denied 

Number 

Per  Cent 

Number 

Per  Cent 

Number 

Per  Cent 

Solo  practice 

313 

460,300 

74 

105,641 

84 

30,720 

89 

MD 

232 

252,451 

40 

48,149 

38 

14,242 

41 

DO 

81 

207,849 

33 

57,492 

46 

16,478 

48 

Group  practice* 

45 

165,778 

26 

20,655 

16 

3,809 

11 

Total 

358 

626,078 

100 

126,296 

100 

34,529 

100 

*  Includes  facilities  with  no  resident  physicians. 


Specialty 

Specialty  was  determined  for  virtually 
all  providers  (Table  3.3).  Group  practices 
were  classified  as  1  of  5  single  specialties, 
multispecialty,  or  unknown.  The  7  "non- 
physician  facilities"  appear  in  either  the 
general  practice  or  unknown  classification 
of  group  practice. 

General  practitioners  in  solo  practice 
accounted  for  the  bulk  of  the  ambulatory 
visits,  injections  billed,  and  (especially) 
injections  denied.  In  addition,  DO 
obstetricians/gynecologists  and  all  other 
DO  specialists  apparently  accounted  for  a 
disproportionately  large  number  of  injec- 
tions denied.  Pediatrics  and  internal  medi- 
cine appeared  to  be  under-represented 


among  injections  denied.  Although  the 
multispecialty  clinics  accounted  for  a  large 
fraction  of  ambulatory  visits,  they  contrib- 
uted only  a  very  small  proportion  of  injec- 
tions denied. 

Outlier  Physicians 

Oudiers  among  the  solo  physicians  ac- 
counted for  only  14  per  cent  of  the  am- 
bulatory visits  and  29  per  cent  of  the  injec- 
tions billed  over  the  4  years  (Table  3.4). 
They  were  responsible  for  a  large  percen- 
tage of  injections  denied  (41  per  cent).  By 
contrast,  the  remaining  solo  providers  ac- 
counted for  60  per  cent  of  ambulatory  vis- 
its, 54  per  cent  of  injections  billed,  and  49 
per  cent  of  injections  denied. 


Table  3.2    Distribution  of  Services  by  Board-Certification  Status, 
Type  of  Provider,  and  Type  of  Practice 


Ambulatory  Visits  Injections  Billed  Injections  Denied 

Number  of       

Type  of  Provider       Providers       Number      Per  Cent     Number      Per  Cent     Number      Per  Cent 


Board-certified 

130 

214,497 

34 

26,536 

21 

3,862 

11 

MD 

96 

82,186 

13 

10,969 

9 

2,218 

6 

DO 

9 

19,667 

3 

3,338 

3 

646 

2 

Group 

25 

112,644 

18 

12,229 

10 

998 

3 

Non-board- 

certified 

200 

375,405 

60 

89,530 

71 

26,573 

77 

MD 

124 

162,312 

26 

32,381 

26 

9,881 

29 

DO 

69 

185,924 

30 

53,233 

42 

15,679 

45 

Group 

7 

27,169 

4 

3,916 

3 

1,013 

3 

Unknown 

28 

36,176 

6 

10,230 

8 

4,094 

12 

MD 

12 

7,953 

1 

4,799 

4 

2,143 

6 

DO 

3 

2,258 

<1 

921 

1 

153 

<1 

Group 

13 

25,965 

4 

4,510 

4 

1,798 

5 

Total 

358 

626,078 

100 

126,296 

100 

34,529 

100 
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Table  3.4.    Distribution  of  Services  by  Type  of  Provider,  Type  of  Practice 

and  "Outlier"  Status 


I  ypc  oi  ±  rovicler 

Number  of 
Providers 

Ambulatory  Visits 

Injections 

Billed 

Injections  Denied 

Number 

Per  Cent 

N  umber 

Number 

Per  Cent 

MD  solo  practice 

232 

242,451 

40 

48,149 

38 

14,242 

41 

Outlier 

15 

47,510 

8 

17,655 

14 

7,461 

22 

Other 

217 

204,941 

33 

30,494 

24 

6,781 

20 

DO  solo  practice 

81 

207,849 

33 

57,492 

46 

16,478 

48 

Outlier 

7 

36,059 

6 

19,358 

15 

6,621 

19 

Other 

74 

171,790 

27 

38,134 

30 

9,857 

29 

Group  practice* 

45 

165,778 

26 

20,655 

16 

3,809 

11 

Total 

358 

626,078 

100 

126,296 

100 

34,529 

100 

*  There  were  no  outliers  among  group  practices. 


Summary 

These  aggregate  counts  of  services  given 
by  various  classifications  of  providers  con- 
firm findings  from  the  2-year  study:  "bet- 
ter" care  was  concentrated  in  group  prac- 
tices (especially  multispecialty  clinics), 
board-certified  physicians,  MD  pediatri- 
cians, and  (by  definition)  physicians  other 
than  the  several  "outlier"  practitioners. 

Rates  of  Injection  Use  and  Denial 
by  Ambulatory  Visit 

Type  of  Practice  and  Provider 

The  pattern  of  changes  in  rates  of 
injections  billed  per  ambulatory  visit 
as  a  function  of  time  differed  between 
group  practices  and  solo  physicians  (Fig. 
3.1).  The  billed-per- visit  rate  for  groups 
rose  slightly  between  Periods  I  and  II* 
(from  0.13  to  0.15)  before  eventually  drop- 
ping slightly  (to  0.10)  by  the  end  of  4  years. 
The  rates  dropped  markedly  for  both  MD 
and  DO  solo  providers  between  Periods  I 
and  II  (from  0.31  to  0.18  and  from  0.64  to 
0.21)  and  decreased  slightly  thereafter  (to 


*  Recall  that  Period  I  refers  to  the  first  5  months  of 
the  study  before  peer  review,  and  Period  II  refers  to 
the  equivalent  months  2  years  later.  See  Chapter  I  for 
the  full  definition. 


0.14  and  0.17,  respectively,  by  the  end  of 
the  study).  Overall,  the  percentage  de- 
crease in  injections  billed  per  visit  was  24 
per  cent  for  all  group  practices,  56  per  cent 
for  solo  MDs,  and  73  per  cent  for  solo  DOs. 

The  number  of  injections  denied  per 
visit  for  all  providers  including  group  prac- 
tices increased  substantially  in  the  second 
year  of  the  study.  All  providers  showed  a 
dip  in  denials  in  the  third  year  and  a  rise  in 
part  of  the  fourth  year  of  the  study. 

Denial  rates  were  lower  for  groups  than 
for  MD  and  DO  solo  providers.  In  Period  I, 
the  denied-per-visit  rate  for  groups  was 
0.01,  compared  with  0.07  for  MDs  and  0.15 
for  DOs.  In  Period  II,  the  figures  were 
0.01, 0.07  and  0.08,  respectively,  and  by  the 
end  of  the  study,  0.003,  0.02  and  0.02, 
respectively. 

Board  Certification  Status 

In  the  early  months  of  the  study,  both 
certified  and  noncertified  DOs  had  higher 
rates  of  injections  billed  than  did  MDs 
(Fig.  3.2).  By  the  end  of  the  4  years,  how- 
ever, the  certified  DOs  had  rates  compara- 
ble to  (or  lower  than)  their  certified  MD 
counterparts,  and  in  general  the  rates  be- 
came quite  similar. 

In  Period  I,  billed  rates  were  0.49  and 
0.66  for  certified  and  noncertified  DOs, 
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Fig.  3.1.  Number  of  in- 
jections billed  per  am- 
bulatory visit,  by  type  of 
provider. 
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compared  with  0.17  and  0.34  for  MDs 
(Table  3.5).  By  the  end  of  the  study,  the 
rates  were  down  to  0.11  and  0.13  (for  cer- 
tified MDs  and  DOs).  Between  Periods  I 
and  II,  use  of  injections  fell  42  per  cent  for 
all  certified  physicians  and  59  per  cent  for 


all  noncertified  physicians;  between  Pe- 
riod I  and  the  end  of  the  study,  the  declines 
were  52  and  68  per  cent,  respectively. 

Differences  among  providers  were  basi- 
cally the  same  for  injections  denied  and 
injections  billed.  In  Period  I,  provider  type 
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Table  3.5.    Appropriateness  of  Use  of  Injections  by  Type  of  Solo  Provider  and 
Board-Certification  Status,  for  3  Selected  Periods* 


Injections  Billed  Injections  Denied  Injections  Denied 

per  Visit  per  Visit  per  Billed 

Type  of  Solo       

Provider  and  Board-  Period  Period  End  of  Period  Period  End  of  Period  Period  End  of 
Certification  Status          If          II       Study               I           II       Study  I  II  Study 


Total  solo  practice 


MD 

.31 

.18 

.14 

.07 

.07 

.02 

.22 

.37 

.13 

DO 

.64 

.21 

.17 

.15 

.08 

.02 

.24 

.38 

.08 

Total  certified 

.24 

.14 

.11 

.04 

.04 

.01 

.16 

.28 

.10 

Certified  MD 

.17 

.14 

.11 

.02 

.04 

.01 

.15 

.28 

.10 

Certified  DO 

.49 

.11 

.13 

.09 

.03 

.02 

.18 

.27 

.13 

Total  noncertified 

.51 

.21 

.16 

.12 

.08 

.02 

.23 

.36 

.11 

Noncertified  MD 

.34 

.19 

.15 

.07 

.06 

.02 

.20 

.33 

.14 

Noncertified  DO 

.66 

.22 

.18 

.16 

.09 

.02 

.24 

.38 

.09 

Total  unknown 

.84 

.36 

.27 

.29 

.15 

.04 

.35 

.41 

.16 

Unknown  MD 

.93 

.37 

.34 

.38 

.15 

.06 

.41 

.41 

.17 

Unknown  DO 

.67 

.14 

.11 

.14 

.09 

.01 

.20 

.67 

.11 

*  Rates  were  calculated  to  4  decimal  places  and  rounded  to  2  places  for  presentation. 

t  Period  I:  September  1971  to  January  1972;  Period  II:  September  1973  to  January  1974;  End  of  Study:  April 
1975  to  August  1975. 


(MD  or  DO,  whether  certified  or  not)  was 
the  distinguishing  characteristic  in  pre- 
dicting high  or  low  denial  rates.  Within  the 
first  year,  however,  the  key  variable  be- 
came board  certification  status;  by  Period 
II,  the  rates  of  denials  were  quite  similar 
for  MDs  and  DOs  and  stayed  so  until  the 
end  of  the  study. 

Certified  and  noncertified  group  prac- 
tices generally  had  lower  billed  rates  than 
did  the  equivalent  solo-practice  classifica- 
tions. The  number  of  injections  billed  per 
visit  in  Period  I  was  0.12  for  certified 
groups  and  0.16  for  noncertified;  respec- 
tive figures  for  Period  II  were  0.11  and 
0.21,  and  for  the  end  of  the  study,  0.09  and 
0. 12.  By  the  end  of  the  study,  therefore,  use 
of  injections  in  ambulatory  visits  had  de- 
clined about  30  per  cent  for  both  sets  of 
group  practices. 

Specialty 

Data  for  primary  care  providers  by  spe- 
cialty should  be  interpreted  with  care  be- 
cause of  the  small  number  of  physicians 


(although  not  visits)  in  some  classifications 
such  as  pediatrics  (Table  3.6).  In  Period  I, 
all  DO  specialists  except  internists  had 
very  high  rates  of  injection  use  (ranging 
from  0.43  to  0.86  injections  per  visit). 
These  high  rates  dropped  markedly  by  Pe- 
riod II  for  DOs  in  obstetrics/gynecology, 
surgery,  and  general  practice,  stabilizing  at 
rates  similar  to  their  MD  counterparts; 
rates  for  DOs  in  internal  medicine  and 
pediatrics  dropped  to  levels  lower  than 
those  for  their  MD  colleagues.  For  MDs, 
surgery  and  general  practice  had  quite 
high  rates  of  injection  use  (0.33  and  0.37  in 
Period  I)  and  pediatrics  quite  low  (0.16). 
By  Period  II  (and  by  the  end  of  the  study), 
injection  use  by  MDs  in  pediatrics  stayed 
low,  use  in  internal  medicine  and  general 
practice  dropped  to  rates  equivalent  to 
pediatrics,  use  in  surgery  declined  notably 
to  levels  lower  than  pediatrics,  and  use  in 
obstetrics/gynecology  varied  over  time  but 
remained  generally  higher  than  in 
pediatrics. 

Rates  of  injections  billed  were  compared 
between  multispecialty  groups  and  all 
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Table  3.6.    Appropriateness  of  use  of  Injections  by  Type  of  Provider  and 
Specialty,  for  3  Selected  Periods* 


Type  of  Provider 
and  Specialty 


Injections  Billed 
per  Visit 

Period  Period  End  of 
If         II  Studv 


Injections  Denied 
per  Visit 

Period  Period  End  of 
I  II  Study 


Injections  Denied 
per  Billed 

Period  Period  End  of 
I  II  Study 


MD  solo  practice 


General  practice 

.37 

.21 

.16 

.07 

.09 

.02 

.18 

.41 

.15 

Internal  medicine 

.23 

.21 

.11 

.06 

.06 

.01 

.26 

.29 

.09 

Pediatrics 

.16 

.15 

.14 

<.01 

.03 

.01 

.03 

.23 

.10 

Obstetrics/ gynecology 

.23 

.16 

.12 

.06 

.06 

<.01 

.26 

.35 

.01 

General  surgery 

.33 

.09 

.08 

.12 

.03 

.01 

.38 

.37 

.15 

DO  solo  practice 

General  practice 

.61 

.19 

.12 

.13 

.06 

.01 

.22 

.31 

.11 

Internal  medicine 

.24 

.02 

.09 

.04 

<.01 

.03 

.15 

.17 

.33 

Pediatrics 

.43 

.08 

.06 

.06 

.02 

.14 

.28 

Obstetrics/gyn  ecology 

.86 

.41 

.26 

.23 

.21 

.03 

.27 

.51 

.13 

General  surgery 

.65 

.16 

.26 

.19 

.07 

.01 

.29 

.46 

.03 

Multispecialty  groups 

.13 

.11 

.09 

<.01 

.01 

<.01 

.02 

.12 

.03 

All  other  groups 

.20 

.20 

.11 

.02 

.07 

.02 

.12 

.35 

.17 

*  Rates  were  calculated  to  4  decimal  places  and  rounded  to  2  places  for  presentation. 

f  Period  I:  September  1971  to  January  1972;  Period  II:  September  1973  to  January  1974;  End  of  Study:  April 
1975  to  August  1975. 


other  group  practices  together  (both 
single-specialty  and  general  practice)  be- 
cause there  were  too  few  groups  in  any  one 
specialty  to  warrant  further  disaggregation. 
The  billed  rate  went  from  0.13  to  0.11  for 
the  multispecialty  groups  between  Periods 
I  and  II,  and  then  dropped  to  0.09;  for  all 
other  groups,  the  figures  were  0.20,  0.20, 
and  0.11. 

Outlier  Physicians 

Patterns  of  injection  use  for  outlier 
physicians  (both  MD  and  DO)  changed 
considerably  over  time  (more  than  for  all 
other  solo  physicians  taken  together)  (Fig. 
3.3).  Although  the  major  part  of  the  decline 
in  injections  billed  per  visit  for  physicians 
other  than  outliers  was  accomplished 
within  1  year  of  the  start  of  EMCRO  opera- 
tions, nearly  3  years  passed  before  the  out- 
liers reached  an  analogous  low  plateau  in 
injection  use.  Interestingly,  outlier  DOs 
stabilized  at  a  rate  equivalent  to  the  level 
that  all  other  physicians  experienced  dur- 


ing Period  I,  and  outlier  MDs  at  a  some- 
what lower  level,  closer  to  where  all  other 
physicians  had  been  after  1  year  of 
EMCRO  operation. 

For  outlier  MDs  (Table  3.7),  injections 
billed  per  visit  went  from  0.75  to  0.30  be- 
tween Periods  I  and  II,  and  then  declined 
to  0.18  by  the  end  of  the  study;  respective 
rates  for  outlier  DOs  were  0.92,  0.48  and 
0.27.  As  expected,  the  rate  was  substan- 
tially lower  for  MDs  in  Periods  I  and  II 
than  for  DOs  and  more  nearly  alike  by  the 
end  of  the  study.  In  terms  of  the  percentage 
change  over  time  in  injection  use,  the 
4-year  decline  was  as  follows:  outiier  MDs, 
76  per  cent;  outlier  DOs,  70  per  cent;  other 
MDs,  31  per  cent;  other  DOs,  73  per  cent. 

The  rates  of  injection  denials  per  visit  for 
outlier  physicians  were  higher  in  Periods  I 
and  II  for  outlier  DOs  titan  for  outlier  MDs, 
but  by  the  end  of  the  study,  the  rates  were 
virtually  identical  for  the  2  classifications 
and  were  only  slightly  higher  than  the  rate 
for  all  other  physicians. 
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Summary 

The  evidence  from  this  phase  of  the 
study  supported  the  following  views:  1) 
board  certification  had  a  positive  effect  on 
appropriate  use  of  injections  in  both  the 
solo  and  the  group  practice  setting;  2)  spe- 
cialty was  a  distinguishing  characteristic, 
with  poorer  care  generally  associated  widi 


general  practice  and  obstetrics/gynecology 
and  better  care  with  pediatrics;  3)  type  of 
practice  (multispecialty  groups)  had  an  in- 
dependent effect  on  appropriateness  of 
care;  4)  outlier  physicians  improved  most 
in  their  delivery  of  care  but  still  had  high 
rates  of  injection  use  compared  with  their 
peers;  and  5)  the  MD/DO  classification 
became  less  important  during  the  study  in 
predicting  inappropriate  care. 


Table  3.7.    Appropriateness  of  Use  of  Injections  by  Provider  Type  and  Outlier 

Status,  For  3  Selected  Periods* 


Injections  Billed                  Injections  Denied  Injections  Denied 

per  Visit                             per  Visit  per  Billed 

Type  of  Provider       

and                 Period  Period  End  of  Period  Period  End  of  Period  Period  End  of 

Outlier  Status             If         II       Study              I          II       Study  I  II  Study 


Outlier  MD 

.75 

.30 

.18 

.21 

.16 

.03 

.28 

.53 

.17 

Other  MD 

.19 

.15 

.13 

.03 

.04 

.01 

.16 

.29 

.11 

Outlier  DO 

.92 

.48 

.27 

.23 

.19 

.03 

.25 

.40 

.10 

Odier  DO 

.57 

.17 

.15 

.13 

.06 

.01 

.23 

.37 

.08 

*  Bates  were  calculated  to  4  decimal  places  and  rounded  to  2  places  for  presentation. 

t  Period  I:  September  1971  to  January  1972;  September  1973  to  January  1974;  End  of  Study:  April  1975  to 
August  1975. 
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Implicit  Effect  of  EMCRO  on  Injections 

We  calculated  the  number  of  injections 
that  were  prevented  from  being  given  dur- 
ing the  4  years  as  a  crude  quantitative 
measure  of  the  implicit  effect  of  the 
EMCRO  on  quality  of  care.  The  number  of 
injections  prevented  is  the  difference  be- 
tween the  number  actually  billed  over  4 
years  and  the  estimated  number  that  would 
have  been  billed  if  the  rate  of  use  (i.e.,  in- 
jections per  ambulatory  visit)  in,  say,  Pe- 
riod I  had  prevailed  throughout  the  study. 

Over  the  4  years,  some  750,350  ambula- 
tory visits  were  given.  In  Period  I  (when 
use  of  injections  was  rising  and  little  re- 
view was  being  done),  the  average  number 
of  injections  per  ambulatory  visit  was  cal- 
culated to  be  0.42.  Multiplying  this  figure 
by  the  number  of  ambulatory  visits  yields 
the  expected  number  of  injections 
(315,150)  that  would  have  been  given  in 
the  absence  of  peer  review  of  injections. 
The  difference  between  this  figure  and  the 
number  actually  given  (167,690)  yields  an 
estimated  147,460  injections  prevented.  Of 
these,  about  35,000  would  have  been  for 
lincomycin,  15,050  for  tetracycline,  and 
60,450  for  short-acting  penicillin. 

We  estimated  the  gross  dollar  "savings" 
to  the  Medicaid  program  from  injections 
that  were  not  given.  Several  costs  of  an 
injection  might  be  used  to  calculate  such 
savings,  such  as  the  average  billed  cost 
over  the  total  period  ($4. 14),  average  billed 
cost  in  the  first  month  ($4.00),  or  average 
cost  of  antibiotic  injections  ($4.38),  which 
represented  about  one-half  of  injections 
given  and  prevented.  Using  the  $4  figure, 
gross  savings  (i.e.,  before  expenses  of  run- 
ning the  peer  review  system  are  deducted) 
were  conservatively  estimated  to  be  almost 
$590,000  in  4  years. 

Similar  calculations  by  physician  charac- 
teristic were  made  for  the  358  providers 
under  study  here  (Table  3.8).  They  gave  75 
per  cent  of  all  injections  and  had  75  per 
cent  of  the  "prevented"  injections.  Using 


this  measure,  the  EMCRO's  major  effect 
was  on  noncertified  DOs,  principally  those 
in  general  practice.  As  might  be  expected 
from  the  overall  decrease  (of  more  than  70 
per  cent)  in  injections  billed,  for  some  pro- 
vider classifications  the  number  of  injec- 
tions "not  given"  was  higher  than  the 
number  actually  administered.  This  was 
true  most  notably  for  DOs  in  virtually  all 
categories  (i.e.,  certified  and  noncertified, 
all  primary  care  specialties). 

Discussion 

This  phase  of  the  study  brought  out  the 
association  between  certain  characteristics 
of  physicians  and  more  appropriate  use  of 
injections:  these  include  group  practice 
(compared  to  solo  practice),  especially  for 
the  few  multispecialty  clinics;  being 
board-certified;  being  an  MD  rather  than  a 
DO;  and  being  an  MD  pediatrician  (com- 
pared with  most  other  specialties).  All 
physician  types  improved  their  use  of  in- 
jectable drugs,  especially  the  small  set  of 
outlier  physicians. 

These  associations  were  much  more  dis- 
tinct in  Period  I  than  later  in  the  study.  By 
Period  II  (and  certainly  by  the  end  of  the 
study)  the  distinctions  among  providers  in 
appropriate  use  of  injections  had  faded. 
Thus,  the  peer  review  system  served  to 
equalize  care  given  by  differently  trained 
physicians;  i.e.,  ittendedto  dissipate  some 
of  the  variance  of  care  that  arises  as  a  func- 
tion of  innate  features  of  physician  training 
and  practice  setting.  By  the  end  of  the 
study,  being  in  a  group  practice,  being  an 
MD,  or  being  board-certified  was  less  im- 
portant in  predicting  the  appropriate  use  of 
injections  than  it  had  been  formerly.  Care 
in  general  improved,  and  the  spread  be- 
tween the  best  and  worst  physicians  nar- 
rowed. Certainly  a  major  function  of  a  peer 
review  organization  should  be  to  reduce 
the  variance  in  quality  of  care.  Doing  this 
(as  in  New  Mexico)  without  lowering  the 
general  level  of  care  was  viewed  as  a  major 
accomplishment. 


27 


Table  3.8.    Estimated  Number  of  Injections  Prevented  by  Selected 

Provider  Characteristics 


Total  Number  Injections  Billed  Estimated  Number 

of  Ambulatory  per  Visit  of  Injections 

Type  of  Provider*  Visits  in  Period  I  Prevented 


Outlier  MD  47,510  .75  17,980 

Other  noncertified  MD  114,802  .20  8,230 

Certified  MD  82,186  .17  3,000 

Total  MDsf  252,451  .31  30,110 

Outlier  DO  36,059  .92  13,820 

Other  noncertified  DO  419,865  .58  53,050 

Certified  DO  19,667  .49  6,300 

Total  DOst  207,849  .64  75,530 

Noncertified  groups  27,169  .16  431 

Certified  groups  112,644  .12  1,290 

Total  groups  f  165,778  .15  4,210 
MDs 

General  practice  131,385  .38  21,810 

Internal  medicine  35,117  .23  2,010 

Pediatrics  27,336  .16  300 

Obstetrics/gynecology  7,092  .23  580 

Surgery  37,783  .33  6,354 

DOs 

General  practice  139,357  .61  49,710 

Internal  medicine  2,505  .24  410 

Pediatrics  6,036  .43  1,830 

Obstetrics/gynecology  23,190  .86  10,280 

Surgery  29,529  .65  10,910 


*  Includes  only  358  providers  giving  100  or  more  ambulatory  visits  in  the  first  2  years. 

f  Subsets  do  not  add  to  total  because  total  includes  providers  of  unknown  board  certification  status. 


In  interpreting  the  above  findings,  cer- 
tain limitations  in  the  data  or  methods  must 
be  considered.  In  particular,  the  question 
arises  as  to  whether  quality  of  care  can  be 
judged  fairly  without  reference  to  the  type 
of  patient  whom  the  physician  encounters. 
This  is  especially  important  in  populations 
that  have  less  tradition  of  continuity  of  care 
with  a  single  provider — e.g.,  the  poor  or 
the  transient — because  the  physician  may 
not  see  the  patient  again  or  the  patient  may 
not  comply  with  complex  (or  even  simple) 
medical  regimens.  Using  antibiotic  injec- 
tions for  patients  in  whom  a  bacterial  diag- 
nosis is  only  suspected  may  be  more  ac- 
ceptable if  the  physician  believes  the 
patient  may  not  return,  may  not  get  the 
appropriate  laboratory  work  done  (if  it 


must  be  done  elsewhere)  or  may  not  com- 
plete an  oral  medication  regimen.  For 
quality-of-care  research  or  peer  review 
based  on  claim  forms,  using  criteria  that 
depend  on  subtle  factors  of  this  sort  is  ex- 
tremely difficult,  but  as  PSROs  take  on 
ambulatory  care  review,  the  general  issue 
should  receive  greater  attention. 

We  should  not  be  surprised  to  find  that 
use  of  different  types  of  injections  differed 
by  specialty — e.g.,  antibiotics  by  internists 
or  hormones  by  obstetrician/gyne- 
cologists. Apart  from  differences  arising 
from  training  and  individual  preferences, 
different  types  of  physicians  are  at  greater 
or  lesser  risk  of  giving  an  injection  at  all 
(because  of  patient  and  diagnostic  case 
mix)  and  of  giving  an  "inappropriate"  in- 
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jection  (because  of  more-  or  less-strict 
guidelines  for  use).  Interpretations  about 
the  quality  of  care  delivered  by  different 
physician  types  thus  should  be  made 
carefully. 

Certain  of  these  points  were  addressed 
in  the  next  phase  of  the  research.  First, 
because  changes  in  diagnostic  case  mix 
were  not  controlled  for,  we  needed  to  de- 
termine whether  diagnoses  changed  to  fit 
the  injection — i.e.,  whether  physicians  be- 
came sensitized  to  allowable  diagnosis/ 
injection  combinations  and  began  to  use 
ones  that  were  more  acceptable  from  the 
point  of  view  of  EMCRO  guidelines.  This 
question  was  explicitly  examined  in  the 
analyses  reported  in  Chapter  V. 

Second,  using  a  single  criterion  (use  of 
medically  unnecessary  injections)  as  a 
measure  of  overall  quality  in  the  broad 
spectrum  of  primary  care  has  obvious  dis- 
advantages in  terms  of  its  sensitivity  and 
predictive  validity.  One  would  like  to 
know,  for  example,  if  poorer  practice  be- 
haviors as  indicated  by  data  on  all  injec- 
tions will  predict  poor  practice  behaviors 
on  other  grounds  as  well.  If  so,  this  fact  has 
important  implications  for  implementation 
of  the  PSRO  program,  in  that  such  "indi- 
cator" activities  (injections  in  this  case,  but 
perhaps  laboratory  procedures  or  office 
visits  elsewhere)  might  be  used  to  identify 
physicians  outside  the  mainstream  of  med- 
icine who  may  need  specific  additional  in- 
terventions or  sanctions  (such  as  100  per 
cent  review,  more  education,  or  restric- 
tions on  or  removal  from  practice).  Quality 
of  care  as  judged  by  more  sensitive  and 


more  valid  criteria  is  examined  as  part  of 
the  episode  analyses  in  Chapter  VI. 

Third,  although  we  do  not  discuss  the 
programmatic  costs  of  ambulatory  care  re- 
view, we  recognize  the  importance  of 
whether  quality  assessment  and  assurance 
activities  should  be  expected  to  pay  their 
own  way.  The  estimated  dollar  "savings" 
from  injections  prevented  (which  did  not 
include  any  imputed  value  to  iatrogenic  or 
other  side  effects  avoided)  did  not  meet  the 
operating  expenditures  of  the  EMCRO, 
and  probably  cannot  be  expected  to.t  In 
addition,  peer  review  interventions  along 
one  dimension  (e.g.,  use  of  injections)  may 
lead  to  changes  in  practice  behaviors  along 
other  dimensions,  such  as  giving  addi- 
tional services  of  other  types  (e.g.,  pre- 
scription drugs,  additional  visits,  or  diag- 
nostic tests).  This  "substitution  effect"  is 
dealt  with  (in  nonmonetary  terms)  in  the 
episode  analyses  reported  in  Chapter  VI. 
Obviously,  the  total  impact  of  peer  review 
may  be  to  increase  expenditures  on  care  at 
the  same  time  it  improves  quality.  In  this 
situation,  the  "savings"  from  one  aspect  of 
the  review  effort  cannot  be  expected  to 
balance  the  higher  costs  of  (presumably) 
better  care.  These  considerations  suggest 
that  substantially  greater  conceptual  and 
programmatic  attention  must  be  paid  to  the 
trade-offs  between  quality  and  cost  in  qual- 
ity assurance  efforts,  especially  as  PSROs 
expand  their  ambulatory  care  review 
programs. 

t  The  gross  and  net  savings  to  the  Medicaid  pro- 
gram for  the  EMCRO's  review  efforts  were  discussed 
in  more  detail  elsewhere.8 
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IV.  Antibiotics  and  Respiratory  Infections: 
A  Review  of  Relevant  Literature 


THE  REMAINDER  of  this  monograph  fo- 
cuses on  antibiotic  use  in  infectious  dis- 
eases. Special  attention  is  given  to  the  use 
of  intramuscular  (IM)  antibiotics  in  visits 
for  respiratory  infections  and  to  use  of  both 
oral  and  IM  antibiotics  in  entire  episodes 
of  common  respiratory  illnesses. 

To  provide  a  context  in  which  to  examine 
our  methods  and  findings  more 
thoroughly,  we  review  here  pertinent  lit- 
erature in  use  of  antibiotic  drugs  in  general 
and  in  selected  respiratory  conditions,  in- 
dications and  contraindications  for  com- 
mon antibiotics,  patterns  of  use  by  type  of 
physician,  and  practices  related  to  accurate 
diagnosis  of  these  conditions. 

Use  of  Antibiotics 

Prevalence  of  Drug  Use 

Drugs  have  been  administered  by 
intramuscular  (IM)  injection  for  more  than 
a  century.  Injections  are  commonly  used  to 
treat  hospitalized  patients.  In  1976,  for 
example,  Greenblatt  and  Koch-Weser27  re- 
ported that  of  18,100  hospitalized  patients 
in  the  United  States  who  were  monitored 
by  the  Boston  Collaborative  Drug  Surveil- 
lance Program  between  1966  and  1976,  52 
per  cent  received  at  least  1  IM  injection. 
Two  years  later,  among  26,300  patients  so 
monitored,  46  per  cent  received  at  least  1 
IM  injection;  of  the  persons  receiving  in- 
jections, about  22  per  cent  received  an  an- 
tibiotic injection,  over  half  of  which  were 
ampicillin.26  The  major  reasons  for  using 
drugs  in  injectable  form  in  the  hospital  set- 
ting are  that  the  patient's  disease  or  the 
pharmacokinetic  properties  of  the  drug 
preclude  oral  administration  or  make  oral 
administration  less  effective;  e.g.,  the  pa- 
tient may  be  vomiting  or  the  drug  may  not 
be  absorbed. 


When  outpatient  use  was  surveyed,  Al- 
per1  found  that  of  an  estimated  567.6  mil- 
lion office  visits  in  the  United  States  in 
1975,  14  per  cent  involved  the  administra- 
tion of  an  injection  for  therapeutic  pur- 
poses and  5  per  cent  involved  immuniza- 
tions or  desensitization  shots.  He  asserted 
that  IM  injections  are  given  in  the  office 
because  physicians  and  patients  believe 
that  the  "medication  has  been  rapidly  and 
completely  deposited." 1  Yet  many  medica- 
tions are  absorbed  as  effectively  orally  and 
some  medications  are  incompletely  ab- 
sorbed when  given  as  an  IM  injection. 

Most  information  about  the  use  of  an- 
tibiotics, in  either  oral  or  injectable  form,  is 
derived  from  hospital-based  studies.  In  a 
survey  of  20  randomly  selected  general 
hospitals  in  Pennsylvania,  the  Inter- 
Society  Committee  on  Antimicrobial  Drug 
Usage  found  that,  while  in  the  hospital,  28 
per  cent  of  patients  received  1  antibiotic, 
25  per  cent  received  2,  10  per  cent  3,  and  3 
per  cent  4  or  more.42  As  in  the  Boston  study, 
ampicillin  was  the  antibiotic  most  fre- 
quently used,  and  cephalosporins  were 
also  used  quite  often.  About  30  per  cent  of 
all  antibiotics  were  given  for  prophylaxis  to 
prevent  infections  in  surgical  procedures. 
Antibiotics  used  for  prophylaxis  should  be 
stopped  within  48  hours  after  the  surgical 
procedure  because  of  loss  of  efficacy.  Yet 
60  per  cent  of  the  patients  had  prophylaxis 
for  more  than  48  hours;  extension  of  use 
beyond  48  hours  accounted  for  85  per  cent 
of  the  use  of  antibiotics  given  for 
prophylaxis. 

Findings  similar  to  these  have  been 
documented  by  other  observers  in  the  past 
decade.11, 14"48'68,77, 78  Many  of  them  con- 
cluded that  at  least  half  of  the  antibiotics 
used  in  hospitals  are  associated  with  the 
following  problems:  use  of  the  wrong  drug, 
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administration  at  the  wrong  dose,  use  for 
the  wrong  length  of  time,  or  inappropriate 
use  for  the  illness  for  which  it  was  given. 
Elimination  of  such  practices  might  save  a 
few  hundred  million  dollars.14'42  Concern 
about  antimicrobial  use  in  hospitals 
prompted  the  development  of  guidelines 
for  such  drugs  by  an  interdisciplinary 
committee  of  the  Veterans  Administra- 
tion.47-48 

Little  information  is  available  concern- 
ing the  use  of  antibiotics  in  outpatient  med- 
icine, and  almost  none  about  the  use  of 
injectable  antibiotics.  Data  from  the  IMS 
America's  National  Prescription  Audit  of 
800  retail  pharmacies  provide  some  esti- 
mate of  the  level  of  use  of  antibiotics  at  the 
time  the  EMCRO  program  was  operating.20 
The  numbers  of  prescriptions  (in  millions) 
written  for  common  antibiotics  in  1971 
were  as  follows:  tetracycline,  52.9;  penicil- 
lin, 39.4;  ampicillin,  24.5;  erythromycin, 
24.3;  sulfonamides,  17.9;  lincomycin  and 
clindamycin,  4.1;  cephalosporins,  2.2;  and 
chloramphenicol,  0.9.  In  the  next  2  years, 
use  of  cephalosporins  increased  150  per 
cent,  lincomycin  and  clindamycin  68  per 
cent,  ampicillin  42  per  cent,  erythromycin 
30  per  cent,  tetracycline  21  per  cent  and 
penicillin  15  per  cent.  Use  of  sulfonamides 
and  chloramphenicol  stayed  about  the 
same.t  Simmons  and  Stolley78  also  re- 
ported on  secular  trends  in  antibiotic  use; 
between  1954  and  1971,  the  growth  in  an- 
tibiotic use  was  greater  than  the  population 
growth  by  about  60  per  cent.  In  community 
studies  of  prescribing  practices,  antibiotics 
accounted  for  15  to  20  per  cent  of  all  pre- 
scriptions; frequent  problems  with  the  use 
of  antibiotics  were  observed,  including 
prescribing  antibiotics  without  cultures  or 
without  examining  the  patient,  prescribing 
antibiotics  for  viral  illnesses,  prescribing 
chloramphenicol  when  an  alternate  agent 
was  clearly  available,  and  prescribing  an- 


t  By  1977,  however,  declines  in  the  use  of  tetracy- 
cline, chloramphenicol,  lincomycin  and  clindamycin 
were  well  under  way. 


tibiotics  prophylactically  even  in  situa- 
tions where  the  efficacy  of  such  practices 
was  questionable. 

Similar  distributions  of  prescription 
drugs  have  been  observed  in  Medicaid 
programs.  In  New  York,  for  example,  20 
per  cent  of  prescriptions  filled  for  oral 
medications  were  for  anti-infective  agents; 
of  these,  42  per  cent  were  tetracycline,  21 
per  cent  ampicillin  and  15  per  cent  eryth- 
romycin.73 In  New  Mexico,  between  1971 
and  1973,  at  least  27  per  cent  of  all  prescrip- 
tions were  antibiotics;  of  these,  26  percent 
were  penicillin,  25  per  cent  ampicillin,  25 
per  cent  tetracycline  and  11  per  cent 
erythromycin. 

Use  of  Oral  and  Injectable  Antibiotics 
in  Outpatient  Practice  for 
Specific  Diagnoses 

The  widespread  use  of  antimicrobial 
agents  in  ambulatory  care  is  related  to  the 
high  incidence  of  infectious  diseases.  In 
summarizing  this  literature,  Moffet57  indi- 
cated that  as  many  as  80  per  cent  of  all 
illnesses  in  both  adults  and  children  are 
acute  infections,  and  about  60  per  cent  of 
all  infections  are  common  respiratory 
illnesses.  Among  respiratory  infections, 
about  25  per  cent  will  be  upper  respiratory 
(e.g.,  pharyngitis),  55  per  cent  middle  re- 
spiratory (e.g.,  bronchitis),  14  per  cent 
pararespiratory  (e.g.,  otitis  media, 
sinusitus),  and  6  per  cent  lower  respiratory 
(e.g.,  pneumonia).  The  greatest  misuse  of 
antibiotics  occurs  in  patients  with  upper 
and  middle  respiratory  infections. 

Most  antibiotics  used  for  treating  respi- 
ratory infections  have  been  in  common  use 
for  2  to  3  decades,  yet  information  is  sparse 
on  how  they  are  used  or  misused,  espe- 
cially in  terms  of  respiratory  infections.  A 
description  of  some  patterns  of  use  of  these 
drugs  follows. 

Two  decades  ago,  among  410  persons 
seen  mostly  by  private  physicians  for  strep- 
tococcal infections  or  streptococcal  carrier 
states,  55  per  cent  were  treated  with  oral 
penicillin,  32  per  cent  with  IM  long-acting 
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penicillin,  6  per  cent  with  erythromycin, 
and  8  per  cent  (including  30  children 
under  10  years  of  age)  with  tetracycline.  A 
significantly  higher  rate  of  cures  was  ob- 
served for  those  treated  with  penicillin  (in 
either  form)  than  for  those  treated  with 
either  of  the  other  antibiotics.84 

A  decade  later,  a  study  of  visits  to  general 
practitioners  showed  that  of  all  patients 
with  respiratory  illness,  58  per  cent  were 
treated  with  oral  antibiotics;  of  these,  40 
per  cent  were  penicillin,  and  36  per  cent 
tetracycline.32  Patterns  of  antibiotic  use 
varied  by  diagnosis;  antibiotics  were  used 
to  treat  18  per  cent  of  patients  with  coryza, 
37  per  cent  of  those  with  influenza  and  90 
per  cent  of  those  with  tonsillitis  (penicillin 
was  the  drug  of  choice  for  75  per  cent  of  the 
cases  of  tonsillitis  that  were  treated  with 
antibiotics).  The  frequency  of  diagnosis  of 
common  respiratory  illness,  however,  var- 
ied strikingly  and  unexpectedly  among 
these  practitioners.  The  authors  concluded 
that  an  urgent  need  existed  to  define  a  re- 
spiratory illness  in  terms  of  its  presenting 
signs  and  symptoms  so  that  definitions  of 
appropriate  treatments  for  "objective  re- 
spiratory syndromes"  might  be  developed. 

Stolley  et  al.86  reported  that  about  95  per 
cent  of  physicians  gave  1  or  more  prescrip- 
tions to  patients  with  "common  colds" 
(upper  respiratory  infections).  Of  these, 
about  60  per  cent  were  for  antibiotics,  in 
particular  penicillin  and  tetracycline. 
Kunin  et  al.48  noted  that  in  ambulatory  care 
the  most  frequently  used  agents  were 
broad-  and  medium-spectrum  antibiotics 
(tetracycline,  penicillin,  erythromycin  and 
lincomycin),  most  often  for  respiratory 
infections. 

A  high  rate  of  antibiotic  prescribing  in  a 
large  urban  group  practice  was  evidently 
associated  with  more  follow-up  work  for 
the  physician  (largely  for  changing  antibio- 
tics) and  an  above-average  consultation 
rate  for  respiratory  illness.31  The  number  of 
"failures"  of  treatment  (defined  as  either 
the  need  to  prescribe  an  antibiotic  within  2 
weeks  of  a  respiratory  illness  visit  for 
which  no  antibiotic  had  been  initially  pre- 


scribed, or  a  change  in  antibiotic)  was  not 
systematically  associated  with  a  high  or 
low  rate  of  prescribing  antibiotics. 

Ray  and  his  colleagues  have  extensively 
studied  the  use  of  prescription  drugs  in  the 
Tennessee  Medicaid  population. 5,64_66- 75 
The  parts  of  their  work  related  to  variations 
in  antibiotic  use  by  physician  type  are  dis- 
cussed later.  In  general,  they  reported  ex- 
cessively high  use  of  chloramphenicol  and 
tetracycline  in  office  practice  as  well  as  a 
fairly  high  use  of  cephalosporins.  For 
example,  205  physicians  wrote  1,760  pre- 
scriptions for  chloramphenicol  for  more 
than  990  patients  between  July  1973  and 
1974;  during  1976,  1,061  physicians  wrote 
11,500  prescriptions  for  cephalosporins  for 
more  than  7,000  ambulatory  patients. 
Schaffner  et  al.75  reported  that  after 
special-education  mailings  about 
chloramphenicol  and  tetracycline  to  each 
physician  serving  the  Medicaid  popula- 
tion, prescriptions  for  these  2  drugs  di- 
minished (although  not  necessarily  be- 
cause of  the  educational  efforts).  Ray  et 
al. 65,66  analyzed  tetracycline  prescriptions 
in  the  Tennessee  Medicaid  population. 
Despite  an  explicit  warning  in  the  Physi- 
cian's Desk  Reference63  about  use  of  tet- 
racycline in  children  under  8  years  of 
age,  more  than  55  per  cent  of  tetracycline 
syrup  prescriptions  and  96  per  cent  of  tet- 
racycline drops  were  for  such  children.  For 
patients  older  than  8  years,  74  per  cent  of 
the  tetracycline  prescriptions  were  for 
upper  respiratory  infections  (URI)  and  an 
additional  5  per  cent  were  for  pneumonia. 
Of  the  nearly  1,290  children  younger  than 
8  years  old  who  received  tetracycline,  80 
per  cent  received  it  in  syrup  form.  Among  a 
group  of  pregnant  Medicaid  patients,  sys- 
temic anti-infectives  were  the  most  fre- 
quent prescription  drugs  apart  from  dietary 
supplements.  Although  these  were  mostly 
penicillins,  a  nontrivial  number  of  recip- 
ients received  tetracycline  and  2  received 
chloramphenicol.5 

Finally,  Stott87  examined  the  outcome  of 
URI  (coryza,  nonspecific  URI,  tonsillitis  or 
pharyngitis  or  both,  and  cough)  among 
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children  9  and  younger  seen  by  one  of  7 
physicians  studied.  Of  the  965  children 
seen  with  a  new  URI  episode,  40  per  cent 
received  an  antibiotic.  Among  the  7  physi- 
cians, antibiotic  use  varied  from  20  to  60 
per  cent.  Of  these  965  children,  24  per  cent 
were  seen  again  for  the  same  or  related 
diagnosis.  Among  this  group  were  61  true 
complications  of  the  disease  process,  the 
majority  of  which  related  to  the  develop- 
ment of  acute  otitis  media  or  lower  respira- 
tory tract  infection.  No  correlation  was  ob- 
served between  antibiotic  use  and  number 
of  complications,  recall  (return)  rates  or 
further  infection. 

Recommended  Uses  for  Antibiotics 

Several  recent  publications  give  de- 
tailed recommendations  for  proper  use  of 
antibiotics  in  certain  diagnoses.  In  1978, 
Eichenwald  and  McCracken17,52  thor- 
oughly reviewed  antimicrobial  therapy 
in  children,  which  is  especially  rel- 
evant to  this  study  of  a  Medicaid  cohort, 
one-half  of  which  is  children.  Their  major 
recommendations  and  observations  in- 
clude the  following:  Cephalosporins 
should  be  used  mainly  for  infections  from 
gram-positive  bacteria,  especially  when  a 
child  is  allergic  to  penicillin  and  suffi- 
ciently ill  to  need  hospitalization.  The 
"widespread  use"  of  these  agents  as 
"broad-spectrum"  antibiotics  has  no  logi- 
cal or  practical  basis;  "in  particular,  their 
relative  inefficiency  against  H.  influenzae 
argues  against  use  in  children  with  otitis 
media."  Chloramphenicol  should  be  lim- 
ited to  specific  situations,  such  as  typhoid 
fever,  that  occur  very  infrequently  in  a  gen- 
eral population;  it  should  not  be  used  for 
middle  and  upper  respiratory  infections. 
Similarly,  lincomycin  and  clindamycin 
should  be  restricted  to  unusual  circum- 
stances in  which  gram-positive  dis- 
ease cannot  be  treated  by  other  less  toxic 
antibiotics  and  to  bacteroides  and  related 
anaerobic  infections.  Tetracyclines  have 
very  few  uses  in  pediatric  practice  because 
of  their  side  effects  and  because  they  are 


not  very  effective  against  common  bacteria 
affecting  children. 

Penicillins  as  a  group  are  the  most  gen- 
erally useful  class  of  antibiotics  for  infants 
and  children.  Penicillin  G  is  the  drug  of 
choice  for  infections  caused  by,  among 
other  bacteria,  beta-hemolytic  strep- 
tococci. It  is  more  effective,  less  toxic  and 
less  expensive  than  other  antimicrobials 
that  might  be  considered  in  such  cases. 
Some  penicillin  preparations  such  as 
penicillin  V  are  acid-stable  (i.e.,  not  de- 
stroyed by  stomach  acid)  and  thus  are  suit- 
able for  oral  use.  Others  are  resistant  to 
breakdown  by  beta-lactamase,  an  enzyme 
present  in  many  staphylococcal  infec- 
tions. The  long-acting  penicillins  are  effec- 
tive in  the  treatment  of  beta-hemolytic 
streptococci  infections  and  impetigo.  The 
antistaphylococcal  penicillins  should  be 
reserved  for  patients  suspected  of  having  a 
severe  staphylococcal  infection. 

Erythromycin  use  is  recommended 
principally  for  relatively  self-limiting  in- 
fections, especially  those  caused  by  beta- 
hemolytic  streptococci  (i.e.,  for  ambulatory 
therapy  of  a  streptococcal  sore  throat  in  a 
person  allergic  to  penicillin).  Ampicillin  is 
a  semisynthetic  penicillin  with  a  broader 
range  than  penicillin.  It  is  effective  against 
many  strains  of  Haemophilus  influenzae,  a 
cause  of  otitis  media  in  children. 

Based  on  this  type  of  information,  the 
authors17,52  state  various  diagnosis-specific 
recommendations.  For  example,  for  acute 
otitis  media,  ampicillin  is  preferred  for 
young  children;  erythromycin/sulfa  or 
penicillin/sulfa  are  also  acceptable. 
Penicillin  is  preferred  for  older  children. 
Acute  sinusitis  is  usually  treated  with 
penicillin  VK  or  ampicillin.  For  strep- 
tococcal pharyngitis,  penicillin  is  the  drug 
of  choice,  with  erythromycin  the  preferred 
alternative  for  allergic  patients.  Because 
laryngopharyngitis  is  almost  always  caused 
by  a  viral  agent,  antimicrobial  therapy  is 
not  effective;  the  exception  would  be  H 
influenza  infections  in  which  case  the 
child  is  toxic,  usually  hospitalized,  and 
treated  with  IM  ampicillin  or  chloram- 
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phenicol.  For  all  these  illnesses,  lincomy- 
cin,  clindamycin  and  cephalosporins 
should  not  be  used  routinely,  and  sulfona- 
mides are  not  acceptable  therapy.  Antibio- 
tic combinations  are  rarely  indicated. 

A  series  of  articles  in  the  British  Medical 
Journal  in  1978  detailed  specific  indica- 
tions for  use  of  antibiotics  in  a  variety  of 
conditions  such  as  urinary  tract  infections, 
septicemia,  surgical  infections,  and  so  on. 
In  some  cases,  these  articles  dealt  specifi- 
cally with  various  types  of  antibiotics. 
Wise94  reiterated  that  the  drug  of  choice  in 
infections  caused  by  beta-hemolytic  strep- 
tococci is  penicillin.  He  made  several 
points:  1)  For  oral  penicillin,  the  acid- 
stable  penicillin  V  is  preferred  to  non- 
acid-stable  penicillin  G.  2)  Oral  penicillin 
V  can  be  used  alone  in  a  mild  infection,  but 
should  be  combined  with  an  injectable 
penicillin  such  as  procaine  or  benzathine 
or  both  in  a  severe  infection.  3)  The 
penicillinase-stable  penicillins  should  be 
reserved  for  staphylococcal  infections. 
With  respect  to  antibacterial  activity,  little 
difference  is  observed  between  ampicillin 
and  amoxicillin;  both  are  important  in 
treating  exacerbations  of  chronic  bron- 
chitis and  otitis  media,  but  should  not  be 
used  in  beta-hemolytic  streptococcal  infec- 
tions because  they  are  less  effective  and 
more  prone  to  produce  rashes.  Reeves  et 
al.67  claimed  that  tetracycline  could  be  con- 
sidered at  least  an  equal  first  choice  for 
acute  exacerbations  of  chronic  bronchitis 
in  adults,  but  should  not  be  used  for  sore 
throats  or  soft  tissue  infections  usually 
caused  by  streptococci  or  Staphylococcus 
aureus.  Noone60  stated  that  amino- 
glycosides (e.g.,  streptomycin,  gentamicin) 
are  not  usually  active  alone  against  strep- 
tococci and  should  be  used  only  rarely  in 
non-life-threatening  infections. 

Several  widely  distributed  publications 
contain  recommendations  that  parallel 
those  described  above.  The  Manual  of 
Acute  Bacterial  Infections22  outlined  cur- 
rent recommendations  for  antibiotic  use 
based  on  the  type  of  bacteria  causing  the 


disease  and  the  type  of  drugs  effective 
against  specific  bacteria.  The  Medical  Let- 
ter on  Drugs  and  Therapeutics54  devoted  a 
recent  issue  to  the  choice  of  antimicrobial 
drugs.  Facts  and  Comparisons43  is  a  com- 
pendium designed  to  provide  a 
wide  scope  of  drug  information  and  to 
facilitate  cost  and  clinical  comparisons 
among  drugs.  Its  sections  on  anti-infectives 
give  details  on  actions,  indications,  contra- 
indications, warnings  and  precautions,  ad- 
verse reactions,  and  administration  and 
dosage.  The  Physician's  Desk  Reference63 
similarly  gives  indications,  contra- 
indications, warnings,  side  effects,  and 
dosage  and  drug  form  information. 

Toxic  Effects  of  Antibiotics 

Common  antibiotics  such  as  penicillin, 
ampicillin,  tetracycline  and  lincomycin 
can  have  major  complications,  which  have 
been  reviewed  in  special  publications95  as 
well  as  in  the  articles  cited  above.  "Supra- 
infection,"  a  phenomenon  associated  with 
many  antibiotics  (especially  broad- 
spectrum  drugs  and  aminoglycosides), 
manifests  as  a  secondary  infection  that 
arises  during  antimicrobial  therapy.  Early 
observers  asserted  that  it  was  a  common 
problem,  occurring  in  more  than  2  per  cent 
of  patients  receiving  a  chemotherapeutic 
agent;  it  was  particularly  frequent  among 
patients  being  treated  for  pneumonia,  otitis 
media,  and  pertussis,  and  among  those  re- 
ceiving aminoglycosides,  tetracyclines  and 
chloramphenicol.91  Later,  it  was  claimed  to 
be  relatively  rare.92 

Few  local  complications  are  produced 
by  an  injection  per  se.  Among  12,100  hos- 
pitalized patients  who  received  at  least  1 
IM  injection,  only  48  developed  a  local 
complication  to  the  injection:  15  had  an 
abscess,  12  a  local  reaction  (e.g.,  erythema) 
and  11  persistent  pain.26  Among  129  pa- 
tients with  strep  pharyngitis  treated  with 
IM  penicillin,  however,  about  one-third 
had  local  reactions  at  the  site  of  the  injec- 
tion.84 One  review  noted  that  almost  all 
classes  of  antibiotics  would  produce  irrita- 
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tion,  such  as  pain  and  erythema,  at  the  site 
of  administration.95 

Most  serious  complications  of  injections 
relate  to  side  effects  of  the  drugs  them- 
selves, which  can  be  severe  and  even  life- 
threatening.  About  5  per  cent  of  patients 
are  admitted  to  hospitals  because  of  drug- 
induced  illness.21  More  than  25  per  cent  of 
all  hospitalized  patients  may  experience  an 
adverse  drug  reaction50;  10  to  30  per  cent  of 
hospitalized  patients  either  experience  or 
give  a  history  of  having  experienced  an 
adverse  reaction  to  an  antibiotic 
medication.21 

Penicillin  has  low  toxicity  but  has  been 
associated  with  the  following  side  effects: 
hypersensitivity  (maculopapular  erup- 
tions), anaphylaxis,  hemolytic  anemia, 
leukopenia,  thrombocytopenia,  neuropa- 
thy and  nephropathy.  These  reactions  are 
rare,  especially  in  doses  administered  to 
pediatric  patients.  For  example,  2  to  3  per 
cent  of  people  taking  penicillin  may  de- 
velop a  rash.  Erythromycin  is  perhaps  the 
least  toxic  antibiotic  available,  but  in  in- 
tramuscular form  it  is  highly  irritating  and 
painful.  Orally,  the  most  common  side  ef- 
fects are  gastrointestinal  disturbances  and 
occasional  mild  allergic  reactions. 

Adverse  reactions  from  ampicillin  in- 
clude the  following:  stomatitis,  nausea, 
vomiting  and  diarrhea;  hypersensitivity 
reactions;  neuropathy;  and  nephropathy. 
About  8  per  cent  of  those  taking  ampicillin 
develop  a  rash.  These  side  effects  are  more 
likely  to  occur  when  the  drug  is  given  orally; 
very  large  doses  given  by  injection  may 
overexcite  the  nervous  system,  resulting  in 
twitching  or,  rarely,  seizures.  Another  ad- 
verse effect  is  suppression  of  normal  gas- 
trointestinal flora,  permitting  overgrowth  of 
certain  resistant  organisms.  For  oral  use, 
amoxicillin  is  definitely  superior  to  am- 
picillin because  it  is  as  effective  and  pro- 
duces distinctly  fewer  gastrointestinal  side 
effects. 

Tetracycline  can  result  in  vomiting, 
diarrhea,  glossitis,  maculopapular  rashes, 
urticaria,  anaphylaxis,  and  hemolytic  and 


aplastic  anemia.  By  far  its  most  serious  side 
effects,  when  used  in  late  pregnancy  and 
childhood  to  the  age  of  8  years,  are  perma- 
nent discoloration  of  teeth  and,  less  com- 
monly, enamel  hypoplasia.  Improper  in- 
travenous use  of  tetracycline  may  cause 
liver  and  renal  necrosis  and  erratic  or  un- 
predictable blood  levels.  Tetracyclines 
have  been  shown  to  produce  inhibition  of 
bone  growth  in  normal  premature  infants; 
in  patients  of  all  ages,  some  association  has 
been  shown  with  signs  of  increased  intra- 
cranial pressure  (pseudotumor  cerebri). 
Finally,  overgrowth  of  highly  resistant  or- 
ganisms, producing  vaginitis  and  proctitis, 
may  also  occur.  One  tetracycline  in  particu- 
lar is  associated  with  appreciable  incidence 
of  vertigo,  dizziness  and,  rarely,  hallucina- 
tions. The  Committee  on  Drugs13  of  the 
American  Academy  of  Pediatrics  cited  sev- 
eral articles  on  adverse  reactions  to  tet- 
racycline and  reiterated  that  few,  if  any, 
reasons  for  using  tetracycline  in  children 
younger  than  8  years  old  can  be  advanced. 
Federal  regulations  against  production  of 
pediatric  forms  (syrups,  drops)  of  tetracy- 
cline have  been  proposed.18,19 

Lincomycin  can  cause  severe  colitis 
which  may  end  fatally.  Other  complica- 
tions include  aplastic  anemia,  mild  to  se- 
vere hypersensitivity  reactions,  tinnitus, 
and  vertigo.  Potentially  serious  toxic  ef- 
fects by  either  the  oral  or  injectable  route 
include,  in  addition  to  the  foregoing, 
gastrointestinal  disturbances,  proctitis, 
vaginitis  and  jaundice.  The  sometimes- 
fatal  colitis  can  develop  weeks  after  the 
drug  has  been  stopped.  Clindamycin  is 
basically  associated  with  the  same  side  ef- 
fects as  lincomycin. 

Chloramphenicol  has  an  enormous 
range  of  toxic  effects,  the  most  serious  of 
which  is  aplastic  anemia  with  pan- 
cytopenia; other  side  effects  include  skin 
rash,  gastrointestinal  reactions,  neurologic 
damage  and  arrest  of  red  cell  maturation. 
In  premature  and  young  infants,  cardio- 
vascular collapse  (gray  syndrome)  may 
occur. 
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Sulfonamides  have  a  variety  of  toxic  ef- 
fects, including  ones  related  to  the  kid- 
neys, bone  marrow  depression,  liver 
toxicity,  various  skin  eruptions  and  photo- 
sensitivity, although  these  are  rare.  The 
most  common  adverse  effects  of  sulfona- 
mides are  mild  headaches,  dizziness  and 
rash.  Renal  toxicity  can  be  reduced  by 
using  a  "triple  sulfa"  preparation  in  place 
of  a  single  sulfa  preparation.  The  so-called 
"long-acting"  sulfonamides  are  accom- 
panied by  an  unacceptably  high  incidence 
of  serious  toxic  reactions,  in  particular  Ste- 
vens Johnson  syndrome. 

Several  authors  have  commented  on  the 
use  of  antibiotics  in  combination  and  fixed 
doses.  Combined  antimicrobial  therapy 
may,  when  used  indiscriminately,  increase 
the  risks  of  severe  infectious  problems.17 
Presumably,  these  include  emergence  of 
resistant  strains,  higher  risk  of  adverse 
reactions,  overgrowth  of  organisms  in  the 
gastrointestinal  and  respiratory  tracts,  and 
possible  neglect  or  delay  in  obtaining  sur- 
gical or  medical  treatment.  Fixed  combina- 
tions of  penicillin  with  other  drugs  may  be 
unjustified  except  when  specific  synergis- 
tic effects  are  intended  or  when  an  infec- 
tion is  definitely  caused  by  more  than  1 
pathogen.94 

Summary 

Antibiotic  use  is  widespread  in  both 
hospital  and  ambulatory  settings.  Many 
viral  infections  are  treated  with  antibiotics; 
in  these  instances,  their  use  is  question- 
able. Tetracycline  should  not  be  used  in  chil- 
dren less  than  8  years  old  or  in  strepto- 
coccal infections.  Lincomycin  and  clinda- 
mycin have  almost  no  place  in  ambulatory 
care,  and  certainly  not  for  the  conditions 
under  study  here.  The  antibiotic  of 
choice  for  common  respiratory  complaints, 
especially  those  caused  by  beta-hemolytic 
streptococci,  is  penicillin,  with  erythromy- 
cin as  an  acceptable  alternative  for  patients 
allergic  to  penicillin.  In  otitis  media,  am- 
picillin  or  amoxicillin  is  the  therapy  of 
choice;  sulfonamide  in  association  with 
penicillin  or  erythromycin  is  an  appropri- 


ate alternative,  or  in  some  practices  even 
the  drug  of  choice,  because  of  the  occur- 
rence of  resistant  strains  of  H.  influenzae. 
When  the  IM  route  for  an  antibiotic  is  de- 
sirable, penicillin  G  benzathine  ("long- 
acting"  penicillin)  is  preferable  to  multiple 
injections  of  penicillin  procaine  or  other 
short-acting  penicillins. 

The  Relationship  Between  Physician 
Characteristics  and  the  Choice  of 
Therapeutic  Agents 

The  major  studies  of  the  relationship  be- 
tween physician  characteristics  and  pre- 
scribing habits  are  summarized  in  Table 
4.1.  The  most  striking  fact  may  well  be  how 
few  studies  have  been  performed.  Knowl- 
edge is  limited  about  the  association  be- 
tween physician  characteristics  and  the 
appropriateness  of  drug  use.  Although 
some  correlation  may  exist  between  better 
prescribing  behavior  and  treating  diseases 
for  which  one  was  trained  (i.e.,  being  a 
"modal"  specialist),  advanced  training  of 
any  sort,  or  being  a  recent  graduate  from 
medical  school,  these  findings  must  be  in- 
terpreted with  caution,  because  little  var- 
iance in  prescribing  behavior  is  predicted 
by  the  physician  characteristics  that  have 
been  studied. 

The  need  to  improve  physician  knowl- 
edge about  the  use  of  antibiotics  also  is 
important.  For  example,  one  "hopefully 
biased"  pilot  survey  documented  that  in  a 
majority  of  cases,  physicians  did  not  know 
the  number  of  individual  drugs  in  combi- 
nation medications  that  they  often  pre- 
scribed and  did  not  know  the  correct 
makeup  of  those  drugs.3  Results  from  the 
National  Antibiotic  Therapy  Test  (NATT) 
indicated  a  general  lack  of  knowledge 
about  how  to  use  antibiotics,  of  drug-drug 
interactions,  drug  side  effects  and  princi- 
ples of  bacteriology.59  For  instance,  on  an 
item  about  shifting  from  penicillin  to 
another  antibiotic  as  treatment  for  Group  A 
beta-hemolytic  streptococcal  disease  if  the 
patient  failed  to  respond  within  48  hours, 
43  per  cent  of  physicians  indicated  they 
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would  switch  drugs  even  though  the  cor- 
rect answer  was  not  to  change.  Good  test 
scores  correlated  positively  with  a  high 
volume  of  inpatient  visits.  In  general,  most 
physicians  scored  better  on  questions  that 
related  to  their  specialties,  but  surgeons 
and  family  practitioners  scored  lower  than 
internists  and  pediatricians. 

The  NATT  questions  were  about  clear- 
cut  therapeutic  situations.  In  many  medi- 
cal situations,  however,  the  correct  diag- 
nosis may  be  unknown  and  the  appropriate 
mode  of  therapy  may  be  debatable.  In 
these  situations,  antibiotics  are  often  used 
without  cultures,  sensitivity  tests  or  clini- 
cal indications. 

In  a  study  of  1,035  admissions  to  a  500- 
bed  nongovernmental  community  hospi- 
tal, 36  per  cent  of  patients  were  treated  for 
infection;  a  team  of  reviewers  concluded 
that  66  per  cent  of  the  therapies  were  "irra- 
tional" and  13  per  cent  were  "rational."68 
Of  the  223  therapies  judged  irrational,  112 
(50  per  cent)  did  warrant  antimicrobial 
therapy;  however,  the  therapy  of  choice 
was  inappropriate.  In  111  (50  percent),  no 
antimicrobial  was  necessary;  92  per  cent  of 
these  patients  lacked  any  clinical  evidence 
of  infection.  Although  cultures  were  or- 
dered for  164  patients  (74  per  cent),  only  49 
per  cent  of  the  patients  given  irrational 
therapies  were  cultured;  57  per  cent  of  the 
rational  therapy  group  were  cultured. 

These  types  of  findings  call  into  ques- 
tion the  therapeutic  judgment  of  the  physi- 
cians studied.  If  physicians  ignore  labora- 
tory and  clinical  data  in  making  decisions, 
or  do  not  use  the  laboratory  appropriately, 
it  will  be  almost  impossible  to  resolve 
genuine  issues  of  therapeutic  controversy, 
such  as  the  treatment  of  sore  throat. 

Controversies  About  Appropriate 
Management  of  Common 
Respiratory  Infections 

Strep  Throat 

Controversy  about  diagnosis  and  treat- 
ment of  strep  throat,  or  strep  pharyngitis, 
illustrates  the  uncertainty  often  facing 


physicians  in  managing  patients  who  pre- 
sent with  a  sore  throat.  The  question  is 
whether  a  person  with  a  sore  throat  should 
be  treated  with  an  antibiotic  on  the  as- 
sumption that  the  inflammation  has  a 
bacterial  (i.e.,  streptococcal),  not  a  viral, 
cause.  Strep  throat  can  be  treated  success- 
fully by  antibiotics;  if  it  goes  untreated, 
however,  it  can  result  in  diseases  such  as 
acute  glomerulonephritis  (kidney  disease), 
acute  rheumatic  fever  and  heart  disease.  A 
viral  sore  throat  does  not  respond  to  an- 
tibiotics; treatment  with  an  antibiotic  ex- 
poses a  patient  to  potential  side  effects 
with  no  concomitant  benefits. 

The  main  controversies  center  on  the  ac- 
curacy of  the  diagnosis  in  the  absence  of  a 
throat  culture  and  on  the  justification  for 
beginning  antibiotic  therapy  without  the 
benefit  of  the  throat  culture  results.  With- 
out a  throat  culture,  in  most  circumstances 
an  experienced  physician  has  a  50  per  cent 
chance  of  predicting  which  sore  throat  will 
be  positive  for  beta-hemolytic  streptococ- 
cus.90 During  epidemics  of  strep  pharyn- 
gitis, an  experienced  physician  will  be  cor- 
rect 75  per  cent  of  the  time.88 

The  diagnostic  problem  is  actually  more 
complex  than  this,  because  as  many  as  13 
per  cent  of  patients  who  have  strep  throat 
and  presumably  would  have  a  positive 
throat  culture  may  have  a  negative  result 
(for  a  variety  of  technical  reasons)  if  only 
one  culture  is  done.83  Moreover,  some  per- 
sons with  positive  cultures  do  not  have 
raised  antistreptolysin  O  titers,  which 
suggests  they  are  transient  or  chronic  car- 
riers of  streptococcus  and  do  not  have  ac- 
tive streptococcal  infection  that  would  re- 
quire antibiotic  treatment.  In  one  study,  for 
example,  more  than  half  of  the  patients  for 
whom  streptococci  were  initially  cultured 
demonstrated  no  subsequent  rise  in 
antibodies.41 

One  report  suggested  that  "quantitative 
assessment  of  the  numbers  of  streptococci 
isolated  on  culture"  is  necessary  to  distin- 
guish between  carriers  and  infected 
persons;  the  diagnosis  of  active  strep 
pharyngitis  requiring  treatment  would  be 
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associated  with  heavy  growth  of  strep- 
tococci.2 Such  a  quantitative  culture  is 
almost  never  obtained  by  practicing 
physicians. 

Experts  disagree  as  to  the  appropriate 
work-up  for  a  patient  presenting  with  a 
sore  throat.  Some  recommend  throat  cul- 
tures for  all  patients  with  a  sore  throat  or  for 
all  "symptomatic"  patients.57  Others  would 
do  cultures  on  patients  with  sore  throats 
who  show  any  fever  (99. 1°  F  or  higher)  or  in 
all  persons  with  fever  higher  than  101°  F, 
regardless  of  the  presence  or  absence  of  a 
sore  throat.30  Still  others  suggest  a  culture 
on  all  children  with  a  temperature  of  101°F 
or  higher,  with  or  without  the  complaint  of 
sore  throat.90  Several  articles  have  outlined 
clinical  "syndromes"  often  associated  with 
positive  strep  cultures.41'55,83'89 

One  expert  on  streptococcal  disease  has 
asserted  that  throat  cultures  are  needed 
(together  with  clinical  and  epidemiologic 
findings)  to  increase  the  accuracy  of  diag- 
nosis of  strep  throat.90  Others  have  argued 
that  strep  pharyngitis  is  "best  defined"  by  a 
throat  culture;  because  treating  undiffer- 
entiated viral  upper  respiratory  infections 
with  antibiotics  produces  no  benefit  and 
may  have  side  effects  in  as  many  as  one- 
third  of  people  taking  antibiotics,  they 
suggested  that  antibiotics  be  used 
carefully.81 

One  group  used  a  decision  analysis 
model  to  estimate  the  cost-effectiveness 
of  various  strategies  to  prevent  acute 
rheumatic  fever  by  treating  pharyngitis 
with  an  antibiotic.  Results  indicated  that, 
under  epidemic  situations,  all  nonallergic 
patients  with  pharyngitis  should  be  treated 
with  penicillin.88  Under  endemic  cir- 
cumstances, the  decision  to  treat  should  be 
based  on  the  probability — derived  from 
clinical  findings — that  the  throat  culture 
would  be  positive;  all  persons  with  a  30  per 
cent  or  greater  chance  of  a  positive  culture 
should  be  treated  without  the  culture,  and 
all  persons  with  a  5  per  cent  chance  or  less 
should  not  be  cultured  or  treated.  Those  in 


between  should  receive  a  throat  culture 
before  the  therapeutic  decision  is  made.  As 
one  example,  adults  with  tender  cervical 
nodes,  temperature  of  100.4°  F  or  higher, 
pharyngeal  exudate  and  no  cough  should 
be  treated  without  waiting  for  culture 
results. 

Komaroff46  elucidated  a  strategy  for  sore 
throat  management  that  recommended  the 
following  actions:  throat  culture  in  all  per- 
sons between  5  and  25  years  of  age  regard- 
less of  clinical  findings  and  in  all  people 
older  than  25  when  certain  signs  and 
symptoms  are  present  (e.g.,  temperature  s= 
100°  F,  exudate,  tender  anterior  cervical 
nodes  or  scarlatiniform  rash).  Treating  be- 
fore results  of  the  throat  culture  are  known 
would  be  justified  in  the  following  situa- 
tions: known  epidemic  of  nephritogenic 
streptococci,  presence  of  scarlatiniform 
rash,  past  history  of  rheumatic  fever  or  di- 
abetes, and  simultaneous  presence  of 
temperature  s=  100°  F,  exudate,  and  tender 
anterior  cervical  nodes. 

Various  advantages  to  early  penicillin 
treatment  without  the  benefit  of  throat  cul- 
tures (defined  variously  as  within  the  first 
24  or  48  hours)  have  been  claimed:  reduc- 
tion in  morbidity  in  first  24  hours55;  a  de- 
crease in  illness  duration88;  less  chance  of 
spreading  disease  to  close  contacts46,88; 
lower  money  and  time  costs  to  the 
patient88;  greater  effectiveness  in  prevent- 
ing acute  rheumatic  fever  (the  most  feared 
late  complication  of  a  strep  infection)88; 
and  possible  identification  of  patients  with 
false-negative  throat  cultures.55  Some  of 
these  claims  are  disputed;  various  authors 
have  claimed  that  early  treatment  is  not 
likely  either  to  alter  the  clinical  course  of 
the  disease46'81,90  nor  to  prevent  acute 
glomerulonephritis.46'81  Because  preven- 
tion of  acute  rheumatic  fever  can  be  ac- 
complished when  treatment  is  begun 
within  the  first  9  days,46,81  waiting  for  the 
results  of  a  throat  culture  before  initiating 
treatment  would  seem  to  be  safe.  Wan- 
namaker90  argued  that  delaying  penicillin 
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therapy  might  well  prevent  cost,  pain  and 
risk  of  sensitization. 

Otitis  Media 

Similar  controversies  exist  regarding  ap- 
propriate diagnostic  and  therapeutic  prac- 
tices for  acute  or  chronic  otitis  media.  Al- 
though there  is  general  agreement  that 
penicillin  is  the  drug  of  choice  for  otitis 
media  caused  by  pneumococcus  or  strep- 
tococcus and  that  ampicillin,  amoxicillin, 
or  combinations  of  penicillin  or  eryth- 
romycin with  sulfonamides  are  appropri- 
ate for  H.  influenzae  infections,33'34'52 
some82  assert  that  penicillin  and  sul- 
fonamides do  not  produce  better  clinical 
results  than  penicillin  alone.  Moreover, 
many  centers  are  reporting  an  increased 
incidence  of  otitis  media  caused  by 
ampicillin-resistant  strains  of  H.  influen- 
zae. For  example,  87  per  cent  of  all  cases 
in  one  area  were  ampicillin-resistant.76 
Some  question  also  arises  as  to  whether 
tetracycline  is  an  appropriate  therapy  even 
for  children  younger  than  8  years  of  age  in 
H.  influenzae  infections  that  are  resistant 
to  ampicillin.44-45  With  respect  to  diagnosis, 
various  authors  have  noted  that  needle  as- 
piration is  the  only  way  to  establish  the 
identity  of  the  bacterium  causing  otitis 
media,  but  not  all  agree,  apparently,  as  to 
whether  it  is  warranted  in  ordinary  outpa- 
tient practice.  Blue  stone  and  Shurin4  dis- 
cussed many  of  these  issues  regarding 
middle  ear  disease. 

Some  authors  have  asserted  that 
nasopharyngeal  and  throat  cultures  are 
valuable  in  determining  the  cause  of  otitis 
media;  nasopharyngeal  cultures  are  much 
easier  to  obtain  than  needle  aspirations  of 
middle  ear  fluid.  In  fact,  a  72  per  cent 
agreement  has  been  reported  between 
semiquantitative  nasopharyngeal  cultures 
and  cultures  of  middle  ear  fluid.76  Because 
only  3  per  cent  of  physicians  surveyed  re- 
ported performing  myringotomies  (fluid 
obtained  from  the  middle  ear  for  culture) 
for  acute  otitis  media,  instituting  "rational" 


antimicrobial  therapy  based  on  precise 
knowledge  of  the  infectious  agent  would 
be  difficult. 

Moscovice58  noted  in  his  study  of 
episodes  of  respiratory  infections  that  the 
preferred  antibiotic  in  acute  otitis  media  for 
the  Frontier  Nursing  Service  was  penicillin 
plus  sulfa  for  children  younger  than  5  years 
and  penicillin  for  patients  older  than  5.  De- 
congestants (such  as  pseudephedrine)  or 
antihistamines  (such  as  diphenhydramine 
or  Benadryl)  are  also  to  be  given.  Other 
authors  have  claimed  that  use  of  oral  decon- 
gestants in  acute  otitis  media  is  a  wide- 
spread practice,  although  Stickler  et  al.82 
reported  that  administration  of 
pseudephedrine  did  not  improve  the  out- 
come of  acute  otitis  media  in  their  clinical 
trial.  Olson  etal.61  reported  on  arandomized 
double-blind  study  of  children  treated  for 
otitis  media  with  antibiotics  and  either 
pseudephedrine  or  placebo.  They  con- 
cluded that  no  benefit  was  gained  from  the 
pseudephedrine  in  terms  of  preventing 
serous  otitis  media  or  treating  it  once  it  had 
occurred.  Interestingly,  these  authors 
noted  "there  are  no  comprehensive  clinical 
criteria  for  acute  otitis  media  in  the 
literature." 

Comment 

These  unresolved  questions  as  to  appro- 
priate steps  in  diagnosis  and  therapy  illus- 
trate one  set  of  problems  in  peer  review. 
Making  judgments  about  diagnosis  and 
therapy  are  difficult  when  experts  cannot 
agree  on  correct  courses  of  action.  This 
problem  is  mitigated  because  experts  do 
agree  that  such  symptoms  should  be 
treated  with  organism-specific  antibiotics 
that  minimize  side  effects.  In  general, 
bacterial  infections  should  be  treated 
neither  with  more  than  1  class  of  antibiotic, 
to  protect  the  patient  from  exposure  to 
risks  from  2  different  drugs  and  poten- 
tially synergistic  toxic  effects,  nor  with 
antibiotics  that  are  potentially  more  toxic 
than  required. 
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V.  Relationships  Among  Diagnoses,  Injections  and 
Physician  Characteristics 


The  research  reported  so  far  covered 
changes  in  use  of  intramuscular  (IM)  med- 
icines over  time  as  a  function  of  the  peer 
review  system,  the  characteristics  of  physi- 
cians who  gave  the  injections,  and  the  type 
of  injection  given.  The  next  stage  of  the 
research,  which  added  diagnosis  to  the 
analyses,  was  restricted  to  antibiotic  injec- 
tions, for  three  reasons.  First,  use  of  an- 
tibiotic injections  was  widespread  and  rep- 
resented about  50  per  cent  of  all  injections 
given  during  the  period  of  this  study.  Sec- 
ond, the  EMCRO  diagnosis-specific 
criteria  for  use  of  antibiotics  were  more 
specific  than  criteria  for  use  of  other  com- 
monly provided  injections,  such  as  antihis- 
tamines, steroids,  or  antiemetics.  Third, 
antibiotics  have  potentially  serious  side  ef- 
fects. 

Research  Questions 

We  selected  several  topics  for  investiga- 
tion in  this  phase  of  the  study:  1)  Will  peer 
review  prompt  physicians  to  change  the 
diagnoses  they  record  on  claim  forms,  to 
justify  use  of  antibiotic  injections?  If  a  shift 
in  diagnoses  takes  place,  will  physicians 
who  originally  gave  poor  care  in  Period  I 
(as  defined  by  injection  criteria)  demon- 
strate a  greater  shift  than  physicians  who 
gave  average  or  good  care?  Will  such 
physicians  attribute  more  patient  visits  to 
diagnoses  that  might  be  treated  with  an- 
tibiotic injections  as  allowed  by  the 
EMCRO  guidelines?  2)  Can  certain 
diagnosis/injection  combinations  be 
targeted  for  focused  review  because  they 
highlight  differences  between  appropriate 
and  inappropriate  care,  e.g.,  streptococcal 
sore  throat  and  long-acting  (LA)  penicillin 
or  upper  respiratory  infection  (URI)  and 
lincomycin?  3)  Will  primary-care 
specialists  in  internal  medicine  and 


pediatrics  use  antibiotic  injections  more 
appropriately  for  respiratory  symptoms 
than  will  gynecologists,  surgeons  or  gen- 
eral practitioners?  4)  Do  physicians  use  dif- 
ferent types  of  antibiotic  injections  inter- 
changeably, regardless  of  diagnosis,  or  do 
they  specifically  use  different  types  of  an- 
tibiotic injections  for  different  diagnoses? 
5)  Will  peer  review  reduce  the  treatment  of 
viral  illnesses  with  antibiotic  injections? 

Methods 

The  new  element  in  the  analyses  re- 
ported in  this  chapter  was  diagnosis.  We 
grouped  diagnostic  categories  according  to 
4-digit  HICDA-I  codes,  and  selected  24 
groupings  on  the  basis  of  the  frequency 
with  which  they  were  treated  with  antibio- 
tic injections.  The  categories  were  ranked 
from  most-  to  least-likely  to  be  bacterial 
(rather  than  viral)  in  etiology  and  thus  most 
to  least  appropriately  treated  with  antibio- 
tic injections  (Table  5.1).  Rankings  were 
based  on  a  review  of  the  literature  and  the 
judgment  of  3  internists  and  2  pediatricians 
that  the  disease  has  a  bacterial  rather  than  a 
viral  etiology;  for  example,  pelvic  inflam- 
matory disease,  a  bacterial  diagnosis  for 
which  antibiotics  are  highly  recom- 
mended, was  ranked  higher  than  gastritis, 
a  disease  for  which  antibiotics  would  not 
be  appropriate.  The  physicians  ranked  the 
diagnoses  independently;  final  rankings 
were  arrived  at  through  discussion.  Al- 
though the  internal  ordering  of  closely 
ranked  diagnoses  may  be  debatable,  diag- 
noses at  the  top  of  the  spectrum  are  clearly 
most  often  bacterial  in  origin,  and  those  at 
the  bottom  most  often  viral. 

Ranking  diagnoses  was  necessitated  by 
the  nature  of  the  Medicaid  claims  data.  On 
all  claim  forms  for  office  visits  and  in- 
jections submitted  for  reimbursement,  the 
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Table  5.1.    Infectious  Disease  Categories  and  Corresponding 
HICDA-I  Codes  Ranked  in  Order  from  "Most  Bacterial" 
to  "Most  Viral"  in  Origin 


Ranking  from 
Most  to  Least 

Bacterial  in  HICDA-I  Name  of  Diagnostic 

Etiology  Code  Category 


1 

34.0 

2 

612.0-614.9 

616.0 

3 

98.0-  98.9 

4 

590.1-590.9 

5 

381.0-381.9 

6 

680.0-684.9 

686.0-686.9 

7 

461.0-461.9 

503.0-503.9 

8 

481.0-486.9 

9 

462.0-462.9 

463.0-463.9 

10 

595  0-595  9 

599.9 

11 

870.0-897.9 

12 

489.0-491.9 

13 

464.0-464.9 

14 

9.1-  9.2 

15 

360.0 

16 

622.1 

17 

788.8 

18 

500.0-500.9 

19 

470.0-470.9 

20 

460.0-460.9 

465.0-465.9 

21 

783.3 

22 

535.0-535.9 

23 

784.1 

24 

519.9 

physician  listed  a  primary  and  (sometimes) 
a  secondary  diagnosis.  For  claims  with  2 
diagnoses,  a  rule  was  needed  by  which  to 
assign  the  service  uniquely  to  1  diagnosis: 
the  operative  rule  was  that  the  service  be 
assigned  to  the  most  "bacterial"  diagnosis 
in  the  list.  For  example,  a  visit  with  the 
dual  diagnoses  strep  throat  and  URI  was 
counted  as  a  visit  for  strep  throat;  similarly, 
if  the  claim  form  for  a  visit  and  an  ampicil- 
lin  injection  contained  the  diagnoses  otitis 
media  and  URI,  both  the  injection  and  the 
visit  were  assigned  to  otitis  media.  This 
hierarchical  rule  avoided  double-counting 
diagnoses  and  visits,  gave  the  physician 
the  benefit  of  the  doubt  in  use  of  IM  an- 
tibiotics, and  prevented  using  a  "primary" 


Streptococcal  sore  throat 

Pelvic  inflammatory  disease 

Gonococcal  infection 
Pyelonephritis 
Otitis  media 

Skin  infection  (including 
cellulitis  and  impetigo) 

Sinusitis 

Pneumonia  (bacterial) 
Pharyngitis/tonsillitis 

Cystitis  (including  urinary 

tract  infection) 
Laceration;  open  wound 
Bronchitis 

Laryngitis  (including  tracheitis) 
Diarrhea;  gastroenteritis 
Conjunctivitis 
Vaginitis 

Fever  of  unknown  origin 
Hypertrophy  of  tonsils 
Influenza 

Acute  upper  respiratory 

infection  (URI) 
Cough 
Gastritis 

Nausea/vomiting 
Mediastinitis 


diagnosis  that  was  inaccurate  for  purposes 
of  these  analyses. 

Certain  analyses  were  performed  only 
on  selected  diagnostic  categories.  For  in- 
stance, a  subset  of  upper  and  lower  respira- 
tory tract  infections  were  distinguished  as 
to  whether  they  were  likely  to  be  bacterial 
or  viral  in  origin  and  then  aggregated  into  2 
categories.  The  bacterial  respiratory  infec- 
tions were  strep  throat,  pharyngitis/ 
tonsillitis,  otitis  media,  sinusitis,  and 
pneumonia,  and  the  viral  diagnoses  were 
bronchitis,  cough,  laryngitis,  and  acute 
URI. 

Physician  characteristics  studied  were 
type  of  practice  (group  and  solo  practice), 
type  of  provider,  (Doctor  of  Medicine 
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[MD]  or  Doctor  of  Osteopathy  [DO]), 
board  certification  status  (certified,  non- 
certified),  outlier  status  (as  defined  in 
Chapter  I),  and  specialty  (general  practice, 
internal  medicine,  pediatrics,  general 
surgery,  and  obstetrics/gynecology). 
Analyses  in  this  phase  were  restricted  to 
the  use  of  antibiotic  injections,  especially 
short-acting  (SA)  penicillin,  lincomycin, 
ampicillin,  tetracycline  and  long-acting 
(LA)  penicillin  (benzadiine). 

As  in  earlier  chapters,  3  rates  of  use  of 
antibiotic  injections  for  different  diseases 
or  for  different  physician  characteristics 
were  calculated  for  Periods  I  and  II*  as  the 
dependent  variables:  the  billed-per-visit 
rate  (number  of  injections  billed  per  am- 
bulatory visit),  the  denied-per-visit  rate 
(number  of  injections  whose  payment  was 
denied  per  ambulatory  visit),  and  the 
denied-per-billed  rate  (the  number  of  in- 
jections for  which  payment  was  denied  di- 
vided by  the  number  billed).  Changes  in 
the  first  of  these  dependent  variables  over 
time  were  used  to  clarify  relationships 
among  diagnoses,  physician  characteris- 
tics, and  use  of  antibiotic  injections. 

Results 

Treatment  of  Infectious  Diseases 
by  Type  of  IM  Antibiotic 

All  Infectious  Diseases.  The  24  diag- 
noses, ranked  by  number  of  visits  in  Period 
I  in  Table  5.2,  represented  almost  60  per 
cent  of  all  ambulatory  visits  and  more  than 
90  per  cent  of  the  antibiotic  injections  in 
both  periods.  In  Period  I,  the  top  10  diag- 
noses (acute  URI,  pharyngitis/tonsillitis 
[hereafter  pharyngitis],  bronchitis,  otitis 
media,  diarrhea,  cystitis,  influenza,  skin  in- 
fection, laceration  and  strep  throat)  ac- 
counted for  50  per  cent  of  visits  and  79  per 
cent  of  antibiotic  injections.  In  Period  II, 
the  rank  ordering  and  percentage  of  visits 


*  As  before,  Period  I  was  September  1971  through 
January  1972,  before  active  peer  review  of  injections; 
Period  II  was  September  1973  through  January  1974. 


attributed  to  these  diagnoses  changed 
slightly.  For  example,  pharyngitis  replaced 
acute  URI  as  the  most  common  diagnosis. 
The  percentage  of  visits  attributed  to  acute 
URI,  bronchitis,  otitis  media,  and  in- 
fluenza decreased;  the  percentage  attri- 
buted to  strep  throat,  sinusitis,  and  cystitis 
increased.  Generally  speaking,  however, 
the  proportion  of  all  ambulatory  care  visits 
in  the  Medicaid  population  accounted  for 
by  the  same  common  infectious  diseases 
remained  constant. 

For  these  24  diagnoses,  the  billed-per- 
visit  rate  for  injectable  antibiotics  de- 
creased from  0.24  in  Period  I  to  0.08  in 
Period  II  (see  the  last  2  columns  of  Table 
5.2).  In  Period  I,  visits  for  strep  throat, 
pharyngitis,  pneumonia,  bronchitis,  and 
influenza  were  treated  at  least  50  per  cent 
of  the  time  with  injectable  antibiotics.  Vis- 
its ascribed  to  various  other  respiratory  in- 
fections also  involved  significant  numbers 
of  antibiotic  injections,  including  0.46  for 
laryngitis,  0.39  for  acute  URI,  and  0.29 
for  cough.  Ry  Period  II,  the  number  of 
antibiotic  injections  given  to  treat  these 
diseases  had  decreased  markedly.  The 
only  diagnosis  still  managed  primarily 
with  injectable  antibiotics  in  Period  II  was 
strep  throat  (billed-per-visit  rate  of  0.60). 

Typical  Infectious  Diagnoses.  Patterns 
of  injection  use  were  studied  in  greater 
depth  for  8  diagnoses:  acute  URI,  pharyn- 
gitis, bronchitis,  otitis  media,  diarrhea,  cys- 
titis, influenza,  and  strep  throat.  Of  these,  4 
(strep  throat,  pharyngitis,  cystitis,  and  otitis 
media)  have  a  high  probability  of  having  a 
bacterial  cause;  the  other  4  are  commonly 
considered  viral.  Data  on  2  diagnoses  from 
the  "bacterial"  group  and  2  from  the  "vi- 
ral" group  (see  Table  5.3)  are  discussed 
below. 

Strep  throat:  The  number  of  visits  for 
strep  throat  increased  about  30  per  cent 
between  Periods  I  and  II.  As  a  percentage 
of  all  visits,  strep  throat  went  from  1.6  to  2.0 
per  cent.  During  Period  I,  an  IM  antibiotic 
was  used  in  63  per  cent  of  the  visits  for 
strep  throat.  Of  these  injections,  56  per  cent 
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were  SA  penicillin,  26  per  cent  lincomy- 
cin,  20  per  cent  LA  penicillin,  3  per  cent 
tetracycline,  and  the  remainder  ampicillin, 
other  antibiotics  or  various  antibiotic  com- 
binations. In  Period  II,  60  per  cent  of  strep 
throat  visits  involved  an  antibiotic  injec- 
tion: the  preferred  antibiotics  were  LA  and 
SA  penicillin  (69  and  22  per  cent),  respec- 
tively, and  lincomycin  was  no  longer  used. 

Pharyngitis:  Pharyngitis  constituted 
about  10  per  cent  of  all  visits  in  both  pe- 
riods. The  EMCRO  review  guidelines 
permitted  certain  antibiotics  as  a  treatment 
for  pharyngitis,  consistent  with  the  belief 
that  the  diagnosis  of  pharyngitis  might  be 
used  interchangeably  with  the  more 
specific  diagnosis  of  strep  throat  and  that 
some  people  with  pharyngitis  might  in  fact 
have  a  streptococcal  infection.  The  percen- 
tage of  visits  for  pharyngitis  associated 
with  an  antibiotic  injection  of  any  type  fell 
from  56  to  27  per  cent  between  the  2  pe- 
riods. In  Period  I,  SA  penicillin  made  up  57 
per  cent  of  all  antibiotic  injections  for  this 
diagnosis,  lincomycin  about  25  per  cent, 
and  LA  penicillin  10  per  cent.  In  Period  II, 
pharyngitis  was  seldom  treated  with  lin- 
comycin or  any  other  antibiotic  except  LA 
or  SA  penicillin  (57  and  32  per  cent). 

Bronchitis:  Bronchitis  made  up  approx- 
imately 8  per  cent  of  all  visits  in  Period  I 
and  7  per  cent  in  Period  II.  In  the  former, 
52  per  cent  of  the  visits  resulted  in  an  an- 
tibiotic injection;  in  the  latter,  only  13  per 
cent.  In  Period  I,  SA  penicillin  and  lin- 
comycin were  used  with  equivalent  fre- 
quency (42  and  40  per  cent,  respectively,  of 
all  antibiotic  injections  for  bronchitis);  tet- 
racycline was  another  9  per  cent.  In  Period 
II,  use  of  antibiotic  injections  was  confined 
almost  entirely  to  SA  and  LA  penicillin  (43 
and  38  per  cent,  respectively,  of  the  small 
number  given). 

Acute  URI:  Acute  URI  was  responsible 
for  11  per  cent  and  8  per  cent  of  all  visits  in 
Periods  I  and  II;  39  per  cent  of  Period  I 
visits  and  9  per  cent  of  Period  II  visits  were 
treated  with  injectable  antibiotics.  Of  the 
Period  I  injections,  66  per  cent  were  SA 


penicillin,  15  per  cent  lincomycin,  10  per 
cent  tetracycline,  and  7  per  cent  LA 
penicillin.  In  Period  II,  the  distribution 
was  as  follows:  64  per  cent  SA  and  18  per 
cent  LA  penicillin  and  6  per  cent  (each) 
lincomycin  and  tetracycline. 

Summary:  These  4  diagnoses  accounted 
for  just  under  60  per  cent  of  the  IM  anti- 
biotics in  both  periods.  For  each  diagnosis, 
lincomycin  was  heavily  used  in  Period  I 
and  appeared  to  be  the  physician's  second 
drug  of  choice.  By  Period  II,  use  of  inject- 
able antibiotics  had  fallen  dramatically  for 
acute  URI,  pharyngitis  and  bronchitis,  and 
remained  the  same  for  strep  throat.  Use  of 
lincomycin  was  cut  drastically,  and  the  an- 
tibiotic of  choice  for  both  pharyngitis  and 
strep  throat  became  LA  penicillin.  These 
changes  were  all  consistent  with  EMCRO 
guidelines. 

Use  of  Injectable 
Antibiotics  by  Diagnosis 

This  section  gives  the  diagnoses  for 
which  5  antibiotics  (LA  and  SA  penicillin, 
ampicillin,  lincomycin,  and  tetracycline) 
were  used  and  describes  changes  between 
the  2  periods.  Because  the  EMCRO  in- 
tended to  curtail  drastically  the  use  of  lin- 
comycin, tetracycline  and  SA  penicillin, 
and  to  promote  use  of  LA  penicillin  when 
IM  antibiotics  were  required,  these  are 
given  the  most  attention. 

Injections  of  ampicillin  were  rarely  used 
in  either  period.  Its  greatest  use  was  in 
otitis  media  (21  and  25  per  cent,  respec- 
tively, of  all  visits  in  Periods  I  and  II).  It 
will  not  be  considered  further  in  this  sec- 
tion. 

Short-Acting  Penicillin.  Of  the  17,100 
antibiotic  injections  given  in  Period  I, 
more  than  8,600  (50  per  cent)  were  SA 
penicillin;  these  were  primarily  used  for 
pharyngitis  (24  per  cent),  acute  URI  (21  per 
cent),  and  bronchitis  (14  per  cent)  (Table 
5.4).  In  Period  II,  the  number  fell  to  2,500 
(36  per  cent  of  all  IM  antibiotics),  chiefly 
for  the  same  3  diagnoses  plus  strep  throat 
and  otitis  media.  The  billed-per-visit  rates 
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for  all  SA  penicillin  injections  were  0.14 
and  0.04  in  the  2  periods.  Declines  in  use 
occurred  across  all  diagnostic  categories, 
particularly  in  diseases  of  viral  etiology. 

Lincomycin.  More  than  4,300  injec- 
tions of  lincomycin  were  given  in  Period  I 
(25  per  cent  of  all  IM  antibiotics)  (Table 
5.5).  Five  diagnoses  (bronchitis,  pharyn- 
gitis, acute  URI,  otitis  media,  and  in- 
fluenza) accounted  for  about  70  per  cent  of 
these  injections.  In  fact,  bronchitis  alone 
accounted  for  one-fourth  of  these  injec- 
tions. Judging  from  Period  I  rates,  bron- 
chitis, pneumonia,  influenza,  strep  throat, 
sinusitis,  and  pharyngitis  were  relatively 
commonly  treated  with  lincomycin.  By  Pe- 
riod II,  its  use  was  greatly  reduced;  only 
420  such  injections  were  given  (6  per  cent 
of  the  total),  mostly  for  pharyngitis,  bron- 
chitis, and  strep  throat.  The  billed-per-visit 
rate  for  all  lincomycin  injections  fell  from 

0.  07  in  Period  I  to  0.01  in  Period  II. 
Tetracycline.    Approximately  10  per 

cent  of  the  17,100  antibiotic  injections  in 
Period  I  were  tetracycline;  of  these,  about 
63  per  cent  were  given  for  bronchitis,  acute 
URI,  diarrhea,  influenza,  and  pharyngitis 
(Table  5.6).  More  than  10  per  cent  of  all 
visits  for  influenza,  pyelonephritis  and 
diarrhea  involved  a  tetracycline  injection. 
Use  of  tetracycline  almost  disappeared  by 
Period  II  (to  4  per  cent  of  all  antibiotic 
injections).  Its  use  was  confined  chiefly  to 
pharyngitis  and  bronchitis,  and  no  more 
than  1  per  cent  of  the  visits  for  any  diag- 
nosis were  treated  with  tetracycline. 
Long-Acting  Penicillin.    During  Period 

1,  4  diagnoses  accounted  for  over  60  per 
cent  of  the  1,630  LA  penicillin 
injections — pharyngitis,  otitis  media, 
acute  URI  and  strep  throat  (Table  5.7). 
Three  diagnoses  accounted  for  69  per  cent 
of  the  LA  penicillin  use  in  Period  II — 
pharyngitis,  strep  throat  and  otitis  media. 
This  was  the  only  antibiotic  category  in 
which  the  number  of  injections  increased 
over  time  (from  9  to  47  per  cent  of  all  IM 
antibiotics).  Similarly,  the  largest  increases 
in  the  billed-per-visit  rates  between  Pe- 


riods I  and  II  were  for  these  same  3  diag- 
noses: strep  throat,  from  0.12  to  0.43; 
pharyngitis,  0.06  to  0.15;  and  otitis  media, 
0.10  to  0.14. 

Summary.  Infectious  disease  and 
antibiotic  injection  data  from  Period  I  illus- 
trate that  a  small  number  of  diagnoses 
accounted  for  most  injections.  These 
common  diagnoses  were  frequently 
treated  with  intramuscular  antibiotics. 
Figures  5.1  and  5.2  summarize  these  data. 
Figure  5.1  illustrates  that  6  diagnoses  ac- 
counted for  more  than  50  per  cent  of  all  SA 
penicillin,  lincomycin,  LA  penicillin 
(bicillin),  ampicillin  and  tetracycline  in- 
jections, and  three  diagnoses  alone — URI, 
pharyngitis  and  bronchitis — for  more  than 
50  per  cent  of  all  SA  penicillin  and  lin- 
comycin injections.  Figure  5.2  shows  that, 
in  Period  I,  more  than  50  per  cent  of  patient 
visits  attributed  to  strep  throat,  pharyngitis, 
bronchitis  and  influenza  included  an  an- 
tibiotic injection  and  that  more  than  one- 
third  of  visits  attributed  to  otitis  media  and 
URI  involved  an  IM  antibiotic  injection. 

Penicillin  was  the  drug  of  choice  for  5 
diagnoses;  patients  diagnosed  as  having 
bronchitis  were  as  likely  to  receive  lin- 
comycin as  penicillin.  By  Period  II,  SA  and 
LA  penicillin  were  the  only  IM  antibiotic 
injections  given  in  more  than  one-fourth  of 
patient  visits  attributed  to  any  diagnosis. 
Lincomycin  was  almost  never  given.  The 
diagnoses  of  acute  URI,  pharyngitis  and 
bronchitis  accounted  for  almost  50  per  cent 
of  the  SA  penicillin  injections  but  the 
number  of  penicillin  injections  given  in 
Period  II  was  less  than  one-third  the 
number  in  Period  I. 

Changes  in  Diagnoses 
Between  Periods  I  and  II 

To  examine  the  issue  of  possible  delib- 
erate shifts  in  diagnosis,  we  looked  for 
changes  in  selected  diseases  classified  as 
either  "bacterial"  (strep  throat,  otitis 
media,  sinusitis,  pharyngitis  and 
pneumonia)  or  "viral"  (influenza,  acute 
URI,  cough,  bronchitis  and  laryngitis).  We 
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hypothesized  that  if  physicians  were  trying 
to  circumvent  EMCRO  guidelines,  they 
would  (by  Period  II)  alter  the  ratios  of 
bacterial  to  viral  diagnoses.  By  labeling 
more  patients  with  respiratory  symptoms 
as  bacterial,  they  would  be  able  to  justify 
more  fully  their  use  of  antibiotic  injections. 

The  5  bacterial  diagnoses  above  made 
up  about  18  per  cent  of  all  ambulatory  vis- 
its in  both  periods,  and  the  5  viral  diag- 
noses another  2 1  and  16  per  cent  in  Periods 
I  and  II,  respectively.  Of  all  visits  to  MD 
solo  providers,  8  per  cent  in  Period  I  were 
for  these  5  bacterial  diagnoses,  7  per  cent 
for  the  5  viral  diagnoses.  The  figures  were 
8  and  7  per  cent  in  Period  II  as  well.  Of  all 
visits  to  DO  solo  providers,  7  per  cent  were 
bacterial  and  10  per  cent  viral  in  Period  I,  7 
per  cent  bacterial  and  6  per  cent  viral  in 
Period  II.  The  percentages  of  visits  with 
either  bacterial  or  viral  diagnoses  were 
about  the  same  in  Periods  I  and  II  for  all 
primary  care  specialties.  The  largest  dif- 


ferences were  for  DO  general  practitioners 
and  surgeons,  who  labeled  fewer  visits  as 
having  a  viral  etiology. 

These  10  infectious  diseases  accounted 
for  approximately  25,000  and  23,800  visits 
in  Periods  I  and  II,  respectively,  of  which 
roughly  half  were  for  the  5  bacterial  diag- 
noses (Table  5.8).  The  distribution  of 
bacterial/viral  categories  differed  by 
physician  type  (Table  5.8).  Depending  on 
the  specific  physician  category,  between 
44  and  56  per  cent  of  MD  visits  could  be 
classified  bacterial  in  Period  I  and  be- 
tween 48  and  52  per  cent  in  Period  II;  the 
range  for  the  various  DO  categories  was  33 
to  75  per  cent  in  Period  I  and  52  to  63  per 
cent  in  Period  II.  A  marked  increase  in  the 
percentage  of  visits  classified  as  bacterial 
between  Periods  I  and  II  was  observed  for 
outlier  DOs,  other  noncertified  DOs,  and 
noncertified  group  practices;  for  other 
physician  types,  no  such  increase  was  ob- 
served. 


Table  5.8.    Distribution  of  Visits  of  Bacterial  and  Viral  Origin  by 
Type  of  Physician,  Periods  I  and  II 


Period  I  Period  II 

Number  of  Visits  Number  of  Visits 

Type  of    Per  Cent    Per  Cent 

Physician  Total*      Bacterial  Bacterial  Total*      Bacterial  Bacterial 


Outlier  MDf 

2,500 

1,400 

56 

2,500 

1,300 

52 

Other  noncertified  MD 

4,500 

2,000 

44 

4,200 

2,000 

48 

Certified  MD 

2,800 

1,400 

50 

2,900 

1,500 

52 

Total  MDs 

9,800 

4,800 

49 

9,600 

4,800 

50 

Outlier  DOf 

2,700 

900 

33 

1,600 

900 

56 

Other  noncertified  DO 

6,900 

2,700 

39 

6,700 

3,500 

52 

Certified  DO 

800 

600 

75 

800 

500 

63 

Total  DOs 

10,400 

4,200 

40 

9,100 

4,900 

54 

Noncertified  groups 

500 

200 

40 

1,600 

1,000 

63 

Certified  groups 

2,800 

1,600 

57 

2,700 

1,600 

59 

Total  groups 

3,300 

1,800 

55 

4,300 

2,600 

60 

All  others! 

1,500 

600 

40 

800 

400 

50 

Total 

25,000 

11,400 

46 

23,800 

12,700 

53 

*  Total  of  the  5  bacterial  and  5  viral  diagnoses  listed  in  text. 

t  All  outliers  were  noncertified. 

t  For  whom  certification  status  was  unknown. 
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To  explore  this  phenomenon  further,  we 
investigated  diagnoses  relating  strictly  to 
"sore  throat."  In  such  cases,  presumably  1 
of  2  diagnoses  would  be  made:  pharyngitis 


(a  nonspecific  term  for  sore  throat)  and 
strep  throat  (a  specific  term  indicating  the 
presence  of  a  streptococcus,  most  likely 
beta-hemolytic). 
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EMCRO  guidelines  were  written  to  en- 
courage use  of  LA  penicillin  if  an  antibiotic 
injection  were  to  be  given  for  strep  throat 
and  (after  careful  monitoring)  to  permit  the 
same  therapy  for  pharyngitis  as  long  as  it 
was  not  given  too  often.  Under  these  cir- 
cumstances, to  justify  the  use  of  injectable 
antibiotics,  a  physician  might  opt  for  the 
specific  diagnosis  of  strep  throat  for  all 
cases  of  sore  throat  in  which  that  diagnosis 
was  even  remotely  possible. 

This  reasoning  would  be  reflected  in  an 
increase  in  the  percentages  of  cases  of  strep 
throat  between  the  2  periods.  Although  vis- 
its for  strep  throat  increased  slightly  as  a 
percentage  of  all  "sore  throat"  visits  (Table 
5.9)  and  as  a  percentage  of  all  visits  for 
infectious  disease,  from  any  clinical  or  pro- 
grammatic point  of  view,  it  was  not  a  par- 
ticularly meaningful  shift. 

Increases  in  the  percentage  of  "sore 
throat"  cases  labeled  strep  throat  were  ob- 
served especially  for  noncertified  groups, 
outlier  DOs,  and  certified  DOs  (Table  5.9). 
Decreases  were  seen  for  outlier  MDs,  non- 
certified  DOs,  and  all  other  providers.  Cer- 
tified group  practices  and  certified  and 
noncertified  MDs  were  quite  consistent 
over  time  in  their  use  of  the  specific  diag- 
nosis of  strep  throat. 

Within  this  "sore  throat"  class  of  diag- 
noses, some  differences  in  the  choice  of  the 
label  "strep  throat"  or  "pharyngitis"  were 
observed  among  the  different  physician 
categories  (Table  5.9).  As  will  be  seen  in 
results  of  the  episode  analyses  (Chapter 
VI),  certified  group  practices  relied  much 
more  on  throat  or  strep  cultures  in  these 
diagnoses  than  did  any  other  provider 
type.  Thus,  arguably  the  "true"  rate  of 
strep  throat  compared  with  pharyngitis  is 
closer  to  the  one  consistently  observed  for 
the  certified  groups,  namely  about  35  per 
cent  of  all  visits  for  "sore  throat."  Even  in 
Period  II,  some  provider  types  had  percen- 
tages for  strep  throat  markedly  lower  than 
this  (e.g.,  all  solo  practice  MDs);  with  the 
possible  exception  of  DO  outliers  (41  per 
cent)  or  noncertified  groups  (47  per  cent), 


however,  no  physician  types  labeled  a 
markedly  higher  percentages  of  visits  for 
sore  throat  as  strep  throat.  Thus,  we  could 
not  demonstrate  that  physicians  with  the 
highest  overuse  of  injections  labeled  a 
higher  proportion  of  their  patients  with  in- 
fectious diseases  as  having  a  bacterial  con- 
dition. 

In  summary,  we  concluded  that  the 
overall  shift  among  these  Medicaid  pro- 
viders in  terms  of  moving  from  "viral"  to 
"bacterial"  diagnoses  in  general  or  from 
"pharyngitis"  to  "strep  throat"  in  particular 
was  minimal  and,  if  done,  may  have  repre- 
sented a  true  improvement  in  the  accuracy 
or  precision  of  diagnostic  labeling.  Cer- 
tainly in  the  population  as  a  whole,  little  or 
no  clinical  or  programmatic  significance 
should  be  attached  to  the  observed  change. 
These  shifts  do  not  affect  quality  of  care 
interpretations  of  our  results  in  any  mean- 
ingful way.  From  the  point  of  view  of  peer 
review  operations,  however,  such  informa- 
tion might  have  implications  for  more 
stringent  review  of  claims  from  individual 
providers  or  classes  of  physicians. 

Overall  Use  of  IM 
Antibiotics  by  Physician  Type 

Having  established  that  no  critical  shifts 
in  diagnosis  occurred  relevant  to  these 
analyses,  we  examined  more  conclusively 
whether  the  EMCRO  reduced  use  of  in- 
jections in  accordance  with  review 
guidelines.  The  hypothesis  was  that  use  of 
antibiotic  injections  would  fall  more  for  re- 
spiratory symptoms  associated  with  viral 
etiologies  (in  which  antibiotics  were  of 
presumably  no  benefit)  than  for  bacterial 
entities. 

In  Period  I,  the  billed-per-visit  rates  for 
the  5  bacterial  and  5  viral  conditions  listed 
earlier  were  0.46  and  0.29  for  all  MDs  (Ta- 
ble 5.10);  respective  figures  for  Period  II 
were  0.26  and  0.09.  Thus,  by  Period  II, 
MDs  were  giving  only  57  per  cent  as  many 
injections  for  bacterial  infections  as  in  Pe- 
riod I,  and  31  per  cent  as  many  for  viral 
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Table  5.9.    Distribution  of  Visits  for  Strep  Throat  and  Pharyngitis, 
by  Type  of  Physician,  Periods  I  and  II 


Period  I 


Number  of 
Sore  Throat  Visits 


Type  of 

Strep 

Pharyn- 

Til          ■  • 

rnysician 

Throat 

gitis 

Total 

Outlier  MD* 

140 

980 

1,120 

Other  nonce rtified  MD 

90 

1,280 

1,370 

Certified  MD 

60 

640 

700 

Total  MDs 

290 

2,900 

3,190 

Outlier  DO* 

140 

500 

640 

Other  noncertified  DO 

280 

1,370 

1,650 

Certified  DO 

20 

330 

350 

Total  DOs 

440 

2,200 

2,640 

Noncertified  groups 

20 

80 

100 

Certified  groups 

280 

510 

790 

Total  groups 

300 

590 

890 

All  othersf 

90 

280 

370 

Total 

1,120 

5,970 

7,090 

*  All  outliers  were  noncertified. 

f  For  whom  certification  status  was  unknown. 


infections.  DOs  behaved  similarly.  Their 
use  of  antibiotic  injections  for  bacterial  in- 
fections in  Period  II  was  46  per  cent  of  the 
Period  I  level  and,  for  viral  diseases,  21  per 
cent. 

Outliers  among  both  MDs  and  DOs  used 
antibiotics  in  a  high  percentage  of  these 
bacterial  and  viral  illnesses  in  Period  I 
(Table  5.10):  DO  outliers  in  about  90  per 
cent  of  these  visits  and  MD  outliers  in  82 
per  cent  of  bacterial  and  63  per  cent  of  viral 
visits.  By  Period  II,  MD  outliers  cut  an- 
tibiotic use  drastically  in  viral  illnesses  and 
halved  their  use  in  bacterial  cases;  DO  out- 
liers halved  their  use  in  viral  diseases  and 
decreased  use  only  a  little  in  bacterial 
cases. 

In  Period  I,  all  primary  care  specialists 
among  the  MDs  used  antibiotics  for  both 
bacterial  and  viral  illnesses  less  than  did 
the  respective  DO  specialties;  the  one  ex- 
ception (internal  medicine)  was  an  artifact 
of  the  small  number  of  visits  seen  by  DO 


Period  II 
Number  of 


Per 

Sore  Throat  Visits 

Per 

Cent 

Cent 

Strep 

C  j  

Strep 

Pharyn- 

Strep 

Throat 

Throat 

gitis 

Total 

Throat 

1 3 

40 

910 

950 

4 

7 

100 

1,230 

1,330 

8 

9 

80 

690 

770 

10 

9 

990 

9  s^n 

o,uou 

7 

22 

310 

450 

760 

41 

17 

230 

1,780 

2,010 

11 

6 

60 

240 

300 

20 

17 

600 

2,470 

3,070 

20 

20 

330 

370 

700 

47 

35 

310 

520 

830 

37 

34 

640 

890 

1,530 

42 

24 

50 

340 

390 

13 

16 

1,510 

6,530 

8,040 

19 

internists.  MD  specialists  typically  treated 
viral  illnesses  far  less  frequently  with  an- 
tibiotics than  bacterial  illness.  The  various 
specialty  categories  of  DOs,  however,  used 
antibiotic  injections  with  similar  fre- 
quency for  both  categories  of  diagnoses.  By 
Period  II,  DO  and  MD  specialties  had  re- 
duced the  use  of  antibiotic  injections  for 
both  types  of  illnesses.  Comparisons  by 
specialty  could  be  made  only  cautiously 
because  some  specialty  classes  had  few  pa- 
tient visits  in  Period  II;  among  general 
practitioners,  however,  the  use  of  antibio- 
tics by  MDs  and  DOs  was  similar  (about  31 
and  9  per  cent  of  visits  for  bacterial  and 
viral  diagnoses,  respectively). 

Use  of  Specific  IM  Antibiotics 
by  Provider  Type  and  Diagnoses 

The  final  set  of  analyses  in  this  phase  of 
the  study  focused  on  the  use  of  specific 
types  of  antibiotic  injections  for  selected 
patients  by  type  of  provider.  This  allowed 
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us  to  examine  whether  different  specialists 
or  provider  types  used  antibiotics  more  or 
less  appropriately  and  whether  they  used 
antibiotics  interchangeably  (regardless  of 
diagnosis).  Only  major  findings,  generally 
those  that  highlight  differences  among 
providers,  are  reported  here. 

Outlier  MDs.  MD  outliers  used  an- 
tibiotic injections  in  62  per  cent  of  their 
visits  in  Period  I.  The  15  most  common 
infectious  diagnoses  among  these  physi- 
cians had  billed-per-visit  rates  greater  than 
0.50,  suggesting  that  injections  were  given 
for  many  infections  that  probably  were 
viral  in  origin.  Diagnoses  frequently  given 
antibiotics  (generally  SA  penicillin)  in- 
cluded pharyngitis  (0.82), f  sinusitis  (0.81), 
influenza  (0.77),  fever  of  unknown  origin 
(0.73),  bronchitis  (0.68),  and  pyelone- 
phritis (0.59).  By  Period  II,  the  percentage  of 
visits  with  antibiotic  injections  dropped 
markedly  (to  34  per  cent).  In  addition,  the 
type  of  antibiotics  used  changed  radically; 
only  12  per  cent  of  the  visits  involved  an  SA 
penicillin  injection  (compared  with  48  per 
cent  in  Period  I)  and  LA  penicillin  became 
the  drug  of  choice.  Lincomycin  was  almost 
never  used  as  an  injectable  antibiotic  by 
these  physicians. 

Other  Noncertified  MDs  (Outliers 
Excluded).  In  Period  I,  overall  use  of  an- 
tibiotic injections  by  this  category  of  physi- 
cians was  similar  to  that  of  certified  MDs 
except  for  higher  billed-per-visit  rates  for 
gonorrhea  (0.84),  fever  of  unknown  origin 
(0.28),  hypertrophy  of  the  tonsils  and 
laryngitis  (both  0.25),  and  bronchitis  (0.24). 
By  Period  II,  the  number  of  SA  penicillin 
injections  and  the  billed-per  visit  rate  for 
all  infectious  diagnoses  decreased  mark- 
edly. Higher  use  of  LA  penicillin  was  ob- 
served for  pharygitis  (0.18)  and  strep  throat 
(0.42) 

Certified  MDs.  These  providers  sel- 
dom used  injectable  antibiotics  in  either 
Period  I  or  Period  II  (billed-per-visit  rates 
of  0.15  and  0.09,  respectively).  The  4  diag- 

f  Billed-per-visit  rates  in  parentheses  in  this  sec- 
tion. 


noses  treated  most  frequently  with  injecta- 
ble antibiotics  were:  strep  throat  (0.45), 
pneumonia  (0.48),  pharyngitis  (0.26),  and 
gonorrhea  (0.23).  Use  of  antibiotics  de- 
clined for  all  diagnostic  categories  except 
gonorrhea  (0.36)  and  strep  throat  (0.43). 
The  majority  of  patients  with  strep  throat 
were  treated  with  either  SA  or  LA  penicil- 
lin in  both  time  frames,  with  the  latter  fa- 
vored slightly  in  Period  II. 

DO  Outliers.  As  with  MD  outliers,  DO 
outliers  had  a  high  rate  of  use  of  injectable 
antibiotics — 85  per  cent  of  all  visits  in  Pe- 
riod I.  The  URI  complex  of  diagnoses  was 
primarily  responsible  for  this  high  rate,  but 
even  diagnoses  such  as  conjunctivitis  and 
diarrhea  received  antibiotic  injections 
fairly  often  (0.43  and  0.58,  respectively). 
DO  outliers  preferred  lincomycin  for 
treatment  of  many  diagnoses,  with  SA 
penicillin  as  second  drug  of  choice.  Of 
their  Period  I  injections,  more  than  50  per 
cent  were  lincomycin  and  40  per  cent  were 
SA  penicillin. 

During  Period  II  this  group  still  had  the 
highest  rate  of  injections  billed  per  visit 
(0.50)  among  the  different  provider 
categories.  Rates  greater  than  0.50  were 
found  for  hypertrophy  of  the  tonsils,  acute 
URI,  influenza,  laryngitis,  sinusitis,  otitis 
media,  and  bronchitis.  Use  of  injectable 
lincomycin  was  nearly  eliminated;  the  vast 
majority  of  strep  throat  and  pharyngitis 
cases  were  treated  with  LA  penicillin. 

Other  Noncertified  DOs  (Outliers 
Excluded).  Noncertified  DOs  had  a  mod- 
erately high  rate  of  IM  antibiotic  use  per 
visit  (0.55)  in  Period  I.  Twenty-five  per 
cent  of  all  visits  included  SA  penicillin  in- 
jections, 18  per  cent  lincomycin.  Injectable 
antibiotics  (chiefly  SA  penicillin,  occa- 
sionally lincomycin)  were  often  used  to 
treat  the  following:  pharyngitis, 
pneumonia,  fever  of  unknown  origin,  and 
influenza  (all  0.68),  otitis  media  (0.61), 
hypertrophy  of  the  tonsils  and  cough  (both 
0.56).  Use  of  injectable  antibiotics  de- 
clined to  12  per  cent  of  visits  in  Period  II. 
Lincomycin  was  completely  eliminated, 
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Table  5.10.    Antibiotic  Injections  Billed  per  Ambulatory  Visit  for 
Selected  Bacterial  and  Viral  Diagnoses,  by  Provider  Type, 
Certification  Status,  and  Specialty,  Periods  I  and  II 


Period  I 
Antibiotic  Injection 
Rate  per  Visit 


Period  II 
Antibiotic  Injection 
Rate  per  Visit 


Type  of 
Provider 


Bacterial 
Diagnoses* 


Viral 
Diagnoses* 


Bacterial 
Diagnoses 


Viral 
Diagnoses 


Outlier  MDst  .82 

Other  noncertified  MDs  .30 

Certified  MDs  .25 

Total  MDst  .46 

Outlier  DOf  .91 

Other  noncertified  DO  .67 

Certified  DO  .78 

Total  DOsJ  .72 

Noncertified  groups  .15 

Certified  groups  .32 

Total  groups  1  .28 
MDs  in 

Internal  medicine  .36 

Pediatrics  .20 

General  practice  .57 

Obstetrics/gynecology  .00 

Surgery  .32 

DOs  in 

Internal  medicine  .20 

Pediatrics  .70 

General  practice  .74 

Obstetrics/gynecology  .78 

Surgery  .66 


.63  .42  .17 

.19  .18  .06 

.14  .17  .05 

.29  .26  .09 

.90  .73  .46 

.60  .25  .08 

.30  .16  .03 

.67  .33  .14 

.10  .39  .02 

.15  .18  .03 

.12  .28  .08 


.20  .25  .06 

.07  .17  .04 

.34  .31  .09 

.15  .00  .00 

.33  .10  .10 

.00  .00  .00 

.60  .10  .00 

.63  .31  .08 

.79  .49  .54 

.74  .26  .06 


*  Five  bacterial  and  5  viral  diagnoses  listed  in  text, 
f  All  outliers  were  noncertified. 

\  Includes  physicians  with  unknown  certification  status. 


SA  penicillin  was  occasionally  used  to  treat 
the  URI  complex  of  diagnoses  and  reliance 
upon  LA  penicillin  for  strep  throat  and 
pharyngitis  increased. 

Certified  DOs.  These  physicians  used 
injectable  antibiotics  (mostly  SA  and  LA 
penicillin  and  tetracycline)  in  53  per  cent 
of  their  visits  during  Period  I.  Compared 
with  other  physician  types,  certified  DOs 
relied  heavily  on  tetracycline  for  treatment 
of  pelvic  inflammatory  disease  (0.83), 
pharyngitis  (0.80),  and  pyelonephritis  and 


cystitis  (0.44).  Use  of  IM  antibiotics  de- 
creased to  8  per  cent  of  visits  in  Period  II. 
LA  penicillin  accounted  for  the  majority  of 
these  injections  (e.g.,  72  per  cent  of  strep 
throat  visits). 

Group  Practices — Certified  and  Non- 
certified.  Group  practices  seldom  used 
injectable  antibiotics.  The  billed-per-visit 
rate  was  nearly  the  same  in  Periods  I  and  II 
(0.07  and  0.06).  Groups  consistently  used 
LA  penicillin  to  treat  both  strep  throat  and 
pharyngitis,  more  so  in  Period  II  than  I. 
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Treatment  of  "Sore  Throat": 
A  Summary  Example 

To  summarize  the  information  reported 
above,  we  investigated  what  happened  to 
patients  who  came  to  their  physicians  with 
"a  sore  throat"  (i.e.,  pharyngitis  or  strep 
throat).  Table  5.11  gives  the  billed-per- 
visit  rates  for  all  antibiotic  injections  to- 
gether and  specific  antibiotic  injections  for 
the  combined  "sore  throat"  diagnosis.  Use 
of  antibiotics,  not  surprisingly,  dropped  for 
virtually  all  categories  of  physicians.  The 
one  exception  was  noncertified  group 
practices;  one  explanation  for  their  in- 
crease may  be  the  marked  rise  in  "strep 
throat"  diagnoses  observed  for  this  cate- 
gory of  provider. 

Lincomycin  use  decreased  most  (largely 
among  the  DOs  who  had  the  highest  rates 
of  use  initially).  LA  penicillin  use,  as 
would  be  expected,  increased  quite 
dramatically  among  certain  providers,  such 
as  outlier  DOs.  The  differences  by  spe- 
cialty (e.g.,  the  differential  use  of  LA 
penicillin  by  MD  gynecologists  versus 
other  specialists)  must  be  interpreted  with 
caution  because  of  the  small  number  of 
cases  involved;  the  large  majority  of  these 
patients  (among  solo  providers)  were  seen 
by  general  practitioners. 

Discussion 

Although  some  change  was  noted  in  the 
way  certain  physician  categories  recorded 
diagnoses  on  claim  forms  (in  terms  of  favor- 
ing strep  throat  in  situations  of  "sore 
throat"),  no  major  shifts  in  diagnoses  were 
observed.  The  peer  review  process  thus 
did  not  prompt  any  wholesale  effort  to  cir- 
cumvent EMCRO  injection  guidelines  nor 
introduce  any  perverse  incentives  for 
submitting  claims  or  recording  diagnoses. 

Some  physicians  apparently  had  under- 
lying preferences  or  biases  for  antibiotics 
for  all  respiratory  tract  diagnoses;  that  is, 
they  evidently  did  not  carefully  tailor  their 
choice  of  antibiotic  injection  to  specific 


diagnoses  or  patient  age  groups.  This  has 
important  implications  for  medical  educa- 
tion and  training,  suggesting  that  greater 
emphasis  on  selecting  organism-  and 
patient-specific  antibiotics  is  needed  in 
basic  pharmacologic  or  clinical  training. 

The  Period  I  data,  which  presumably  re- 
flected the  "usual"  state  of  care  in  the  New 
Mexico  Medicaid  program,  confirmed 
many  other  observations  that  use  of 
antibiotic  injections  was  associated  with 
deficiencies  in  the  quality  of  care.  These 
deficiencies  were  not  distributed  evenly 
across  physician  types.  For  instance, 
among  DOs,  two-tiiirds  of  all  patients  hav- 
ing common  viral  illnesses  were  treated 
with  injectable  antibiotics;  among  outlier 
DOs,  lincomycin  was  the  drug  of  choice. 
By  contrast,  group  practices  composed  of 
board-certified  physicians  used  antibiotic 
injections  much  more  sparingly  in  bacte- 
rial and  especially  viral  illnesses;  when 
they  did  give  antibiotic  injections,  LA 
penicillin  was  the  preferred  drug. 

Five  injectable  antibiotics  and  10  to  12 
diagnoses  accounted  for  most  antibiotic  in- 
jection use  and  the  reasons  for  which  they 
were  used.  Injections  are  by  no  means  the 
only  relevant  service  to  investigate  or 
monitor  by  a  peer  review  system,  and  ob- 
viously other  acute  and  chronic  illnesses 
must  be  considered.  Nonetheless,  these 
categories  could  be  considered  as  die  core 
of  a  successful  system  for  monitoring  am- 
bulatory care  in  other  Medicaid  programs. 

These  findings  also  support  the  use  of 
focusing  on  the  basis  of  physician  type  or 
physician  profile;  indeed,  this  was  sub- 
sequendy  done  by  the  New  Mexico  PSRO 
(as  discussed  in  Chapter  II).  As  already 
noted,  marked  differences  were  observed 
in  appropriate  use  of  antibiotics  for 
selected  diagnoses  by  board  certification 
status  and  especially  outiier  status.  Little 
evidence  emerged  as  to  whether  different 
types  of  specialists  (primary  care 
specialists  such  as  internists  or  pediatri- 
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cians  compared  with  gynecologists  or  sur- 
geons, or  with  general  practitioners)  sys- 
tematically use  more  or  less  appropriate 
antibiotic  injections  for  the  common  respi- 
ratory diagnoses  studied.  This  was  largely 
because  most  care  for  these  diagnoses  was 
given  by  general  practitioners  (few,  if  any, 
being  newly  trained  "family  practition- 
ers"); hence,  sample  sizes  for  other  physi- 
cian types  were  sometimes  quite  small.  To 
the  degree  that  outliers  were  mainly  in 
general  practice,  the  inference  could  be 
drawn  that  internists  and  pediatricians  did 
give,  on  average,  better  care.  Nonetheless, 
further  analysis  by  all  these  professional 
characteristics  is  warranted. 

These  findings  corroborated  the  conclu- 
sions stated  in  Chapter  III  that  the  New 
Mexico  EMCRO  had  a  major  effect  on  the 
quality  of  medical  care,  by  eliminating  in- 
appropriate injections  given  mainly  for 
problems  of  a  viral  nature,  for  which  an- 
tibiotics are  unlikely  to  be  justified.  It 
brought  about  this  decline  in  2  years,  with- 
out prompting  any  systematic  effort  on  the 
part  of  physicians  to  choose  selectively 
diagnoses  that  would  justify  continued  use 
of  injections.  The  peer  review  system  ap- 
parently developed  rational  guidelines  ac- 
ceptable to  physicians,  appropriately  dis- 
seminated information  about  those 
guidelines,  and  successfully  enforced 
them.  As  stated  in  Chapter  III,  the  peer 
review  efforts  improved  the  average  level 
of  quality  in  this  Medicaid  program  and 
reduced  its  variance,  by  bringing  the  per- 
formance of  outlier  physicians  more  in  line 
with  that  of  the  physician  types  giving  con- 
siderably better  care  throughout  the  entire 
study. 

One  implication  of  these  findings  re- 
garding injections  alone  is  the  possible  role 


of  similar  national  guidelines  for  use  of  in- 
jectable drugs,  promulgated  perhaps  by 
some  national  body  such  as  the  PSRO  Na- 
tional Council.  Such  guidelines  could  be 
aimed  at  "minimal"  criteria  for  appropriate 
use  of  drugs,  perhaps  related  to  a  relatively 
select  group  of  diagnoses  that  account  for 
much  of  the  ambulatory  care  in  the  country 
today.  They  might  specify,  for  example,  the 
types  of  injections  that  are  explicitly  disap- 
proved for  specified  diagnoses  or  age 
groups  or  both  (e.g.,  tetracycline  for  young 
children),  and  how  frequently  an  antibiotic 
should  be  given  for  identified  types  of  pa- 
tients with  given  diagnoses  (e.g.,  for  strep 
infections,  injectable  SA  penicillin  must  be 
either  repeated  or  followed  with  oral 
penicillin  of  the  same  type).  Information 
on  which  to  base  such  guidelines  must 
come  from  "epidemiologic"  data  derived 
from  studies  such  as  this  one,  from  special 
studies  of  the  distribution  of  antibiotics 
used,  from  evidence  in  the  literature  re- 
garding the  efficacy  of  antibiotic  injections 
for  specific  conditions,  and  from  clinical 
trials. 

At  the  end  of  this  phase  of  the  study, 
certain  questions  remained  that  needed  to 
be  addressed  by  investigating  more  com- 
prehensive episodes  of  these  same  ill- 
nesses. The  principal  issues  (apart  from 
methodologic  ones)  were  whether  the 
peculiarities  of  injectable  antibiotics  in  Pe- 
riod I  were  reflected  in  oral  antibiotic  use 
in  either  Period  I  or  II,  whether  the  shift  in 
use  of  IM  antibiotics  was  accompanied  by 
undesirable  changes  in  the  use  of  oral 
drugs,  and  whether  laboratory  tests  were 
used  appropriately  as  an  adjunct  to  making 
the  correct  diagnoses.  These  are  some 
of  the  questions  considered  in  the  next 
chapter. 
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VI.  Quality  of  Care  for  Episodes  of  Common 
Respiratory  Illnesses 


The  ANALYSES  and  discussions  in  the  pre- 
vious chapters  make  clear  that  a  number  of 
topics  have  not  yet  been  fully  addressed, 
especially  those  involving  how  entire 
episodes  of  illness  were  cared  for  in  the 
Medicaid  population  during  the  period  in 
which  the  EMCRO  was  operating.  For 
example,  did  the  inappropriate  use  of  in- 
jections in  the  early  months  of  the  EMCRO 
review  program  reflect  inappropriate  care 
along  other  dimensions  as  well,  such  as  use 
of  office  visits,  diagnostic  tests,  or  prescrip- 
tion drugs?  As  the  use  of  inappropriate  in- 
jections declined,  did  a  quality-of-care- 
related  response  occur  in  other  facets  of 
primary  care,  such  as  increases  in  labora- 
tory tests  to  confirm  diagnoses,  or  substitu- 
tion of  medically  correct  (or  incorrect)  pre- 
scription drugs  for  injectable  drugs?  This 
chapter  reports  the  findings  of  analyses  on 
episodes  of  illness  designed  to  examine 
these  questions. 

In  particular,  the  objectives  of  this  phase 
of  the  study  were  as  follows: 

To  determine  if  episodes  of  care  could  be 
used  as  a  unit  of  analysis  in  evaluating  qual- 
ity of  care. 

To  investigate  the  care  provided  for 
episodes  of  common  ambulatory  illnesses 
in  a  Medicaid  population  using  a  restricted 
set  of  process  criteria  involving  antibiotic 
medications  and  common  laboratory  tests 
to  assess  quality. 

To  determine  if  quality  of  care  in  such 
episodes  differed  by  "structural"  physician 
characteristics. 

To  determine  whether  physicians  who  ap- 
parently gave  poor  quality  of  care  as  meas- 
ured by  a  single  criterion  (use  of  injectable 
drugs)  gave  consistently  poor  care  when 
measured  by  more  than  one  criterion. 

To  evaluate  what  effect  (if  any)  peer  review 
had  on  the  quality  of  ambulatory  care  over 
time. 


Using  Episodes  of  Illness  in  Ambulatory 
Care  Review 

As  the  interest  in  quality  of  ambulatory 
care  has  grown,  so  has  recognition  that 
such  review  preferably  should  be  based  on 
more  than  just  individual  services  or  en- 
counters. Such  review  should  draw  on 
entire  illness  episodes  because  description 
and  assessment  of  the  elements  of  care  one 
at  a  time  misses  the  design,  the  rationale, 
and  the  implications  of  the  strategy  as  a 
whole,  including  the  consequences  of 
taking  or  not  taking  certain  actions.16 

Efforts  to  use  episodes  in  quality  of  care 
work  are  needed  for  several  reasons. 
Focusing  on  entire  episodes  permits  a  bet- 
ter evaluation  of  the  patient's  true  state  of 
health  and  allows  for  analysis  in  terms  of 
progression,  remission,  and  resolution  of 
illness  over  time.  It  permits  investigation 
of  the  possible  substitution  among  services 
and  provides  an  opportunity  to  look  at  the 
timeliness  of  services.  It  can  control  for  the 
probable  availability  or  nonavailability  of 
diagnostic  data  (e.g.,  laboratory  work)  in 
evaluating  other  aspects  of  medical  man- 
agement (e.g.,  drugs,  follow-up  physician 
visits). 

Despite  the  theoretic  advantages  of 
episode  analysis,  it  is  a  poorly  developed 
method,  and  the  literature  in  this  area  is 
sparse  for  both  methods  and  analytic  find- 
ings. The  earliest  explicit  statement  and 
discussion  of  the  rationale  for  using 
episodes  of  care  described  episode 
analysis  as  "clustering  discrete  units  of 
service  into  cohesive  entities"  based  on 
the  patient's  medical  problem,  time  inter- 
val between  services,  and  nature  of  medi- 
cal management.79  Although  this  work  was 
conceptually  forward-thinking,  it  was 
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given  only  little  practical  application,80  and 
none  relating  to  the  use  of  insurance 
claim  forms. 

Lasdon  and  Sigmann49  investigated  the 
feasibility  of  using  episodes  of  care  in  a 
cost-effectiveness  study.  Although  neither 
the  data  source  nor  the  routines  for  creating 
episodes  were  computer-based,  their  re- 
sults suggested  that  episodes  of  a  chronic 
disease  (hypertension)  could  be  created 
from  an  audit  of  patient  records  and  could 
be  used  to  evaluate  health  care  in  different 
types  of  practice  settings. 

Moscovice58  developed  a  set  of 
problem-specific  computer-based  al- 
gorithms for  defining  episodes  of  care  as 
part  of  an  evaluation  of  the  Frontier  Nurs- 
ing Service  in  Kentucky.  He  defined  "pat- 
terns of  care"  for  otitis  media,  pharyngitis/ 
tonsillitis  and  urinary  tract  infection,  and 
studied  variations  in  the  prevalence  of 
those  patterns  by  provider  team  charac- 
teristics (Frontier  nurse,  registered  nurse, 
physician,  and  various  combinations 
thereof)  and  location  (district  office  versus 
central  hospital).  His  work  is  among  the 
first  practical  applications  of  episode 
analysis  for  use  in  quality  assessment.  His 
methods  are  not  entirely  transferable  to 
quality-of-care  review  using  insurance 
claim  forms,  however,  because  his  data 
source  was  an  "encounter  form"  de- 
veloped specifically  for  the  Frontier  Nurs- 
ing Service.  These  forms  provided  "treat- 
ment history"  codes  indicating  actions 
such  as  acute  follow-up  or  routine  care  for  a 
chronic  problem,  data  elements  that  nor- 
mally are  unavailable  on  insurance  claims. 
When  reliable  treatment  history  data  are 
not  available,  creating  episodes  of  illness  is 
substantially  more  difficult.  Moreover, 
Moscovice  did  not  attempt  to  make 
quality-of-care  appraisals  per  se  but  rather 
described  patterns  of  patient  care  proc- 
esses and  variations  as  a  function  of  pro- 
vider characteristics. 

Roos  and  her  colleagues69,71,72  have  used 
computer-based  claim  files  from  provincial 
insurance  records  in  Saskatchewan  and 


Manitoba  to  create  episodes  of  illness  in- 
volving inpatient  diagnoses  such  as  tonsil- 
lectomy and  adenoidectomy.  Their  work 
clearly  supports  the  feasibility  of  using 
episodes  to  describe  the  use  of  medical 
services  and  quality  of  care,  but,  strictly 
speaking,  it  is  not  directed  at  evaluation  of 
the  processes  of  ambulatory  care. 

Kane  and  his  colleagues37-40  carried  out  a 
series  of  studies  on  processes,  outcomes 
and  costs  of  episodes  of  care  in  model  fam- 
ily practice  clinics  in  Utah.  One  study 
compared  outcomes  and  costs  of  care  by 
levels  of  providers  (faculty,  residents, 
physician  assistants).  Their  data  sources 
were  clinic  and  hospital  medical  and  bill- 
ing records,  as  well  as  supplemental  in- 
formation collected  by  interviewers  on  the 
patients'  demographics,  functional  status 
and  satisfaction  with  care.  The  episodes 
studied,  which  covered  a  wide  variety  of 
acute  ambulatory  conditions,  were  as- 
sumed to  begin  at  the  first  patient  visit  to 
the  clinic.  The  physician  at  this  first  visit 
was  asked  to  estimate  the  time  at  which  the 
patient  would  be  restored  to  die  level  of 
functional  status  enjoyed  prior  to  the  pres- 
ent illness.  All  services  between  the  visit 
that  began  the  episode  and  the  follow-up 
interview  performed  by  the  research  team 
at  the  time  specified  by  the  physician  were 
included  in  the  episode.  Their  findings  in- 
clude the  following:  a  positive  relationship 
between  process  and  outcome  measures; 
little  or  no  difference  in  quality  by  level  of 
provider;  and  lower  average  cost  of  an 
episode  of  care  for  patients  with  good  out- 
comes than  for  those  with  bad  outcomes. 

Some  methodologic  questions  can  be 
raised  about  this  work,  such  as  the  possibil- 
ity of  services  in  an  episode  having  been 
given  outside  the  clinic  system  or  before 
the  initial  visit,  the  justification  of  includ- 
ing all  services  in  an  episode  regardless  of 
diagnosis,  and  the  small  sample  size  avail- 
able for  diagnosis-specific  analyses.  It  is, 
however,  one  of  the  first  efforts  reported 
that  attempted  both  to  assess  the  costs  and 
quality  of  care  in  entire  illness  episodes 
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and  to  evaluate  the  care  given  by  different 
types  of  providers;  hence,  it  provides  a  use- 
ful step  forward  in  quality-of-care  research 
and  corroborative  evidence  that  episodes 
are  feasible  analytic  units  that  can  be  used 
in  such  work. 

Gold23  studied  the  "intensity"  of  care 
provided  for  episodes  of  common  outpa- 
tient conditions  or  complaints  (e.g.,  upper 
respiratory  tract  infection,  hypertension, 
chest  pain)  as  a  function  of  location 
(hospital-based  versus  freestanding 
primary  care  clinics  within  a  Kaiser- 
Permanente  system).  Episodes  were 
defined  to  begin  with  the  first  visit  for  die 
given  study  condition  and  to  include 
related  "morbidity  contacts"  (clinical, 
laboratory  and  radiology,  but  not  pharma- 
ceutical) provided  only  by  or  through  the 
actions  of  Kaiser  internists.  (Morbidity  con- 
tact was  defined  as  a  single  diagnosis 
treated  in  a  single  care  contact  within  the 
Kaiser  system.)  Little  difference  in  "in- 
tensity" of  care  was  observed  between  the 
two  locations.  Differences  in  quality  of 
care  were  not  observed  as  a  function  of 
level  of  intensity  of  care. 

Methods 

Study  Population 

To  address  the  5  objectives  listed  above, 
we  evaluated  the  quality  of  care  given  to 
New  Mexico  Medicaid  eligibles  who  had 
been  enrolled  in  the  Aid  to  Families  with 
Dependent  Children  (AFDC)  aid  category 
continuously  between  September  1971 
and  August  1975.  The  AFDC  cohort  was 
chosen  for  analysis  for  several  reasons:  1) 
AFDC  eligibles  were  likely  to  be  rela- 
tively healthy  (in  contrast  to  the  other  aid 
categories  for  which  eligibility  criteria 
were  either  the  presence  of  a  specific 
chronic  condition  or  handicap,  or  old  age); 
2)  altogether,  AFDC  made  up  the  largest 
portion  (about  70  per  cent)  of  Medicaid 
enrollees  in  New  Mexico;  3)  the  AFDC 
cohort  made  up  about  25  per  cent  of 
Medicaid  eligibles  and  accounted  for  more 


than  40  per  cent  of  all  Medicaid  dollars  per 
eligible  per  year8;  and  4)  no  AFDC  eligible 
had  any  "crossover"  between  Medicaid 
and  Medicare  (i.e.,  no  services  were  cov- 
ered first  by  Medicare,  as  is  true  for  Old 
Age  Assistance),  meaning  that  all  data  on 
ambulatory  care  were  contained  in  the 
data  base. 

Conditions  Studied 

We  selected  6  conditions  for  study 
(HICDA-I  codes  given  in  parentheses): 
streptococcal  sore  throat  (strep  throat) 
(34.0),  pharyngitis/tonsillitis  (462.0-.9, 
463.0-.9),  otitis  media  (381.0-.9),  bron- 
chitis (489.0-491.9),  influenza- (470.0-.9) 
and  acute  upper  respiratory  infection 
(acute  URI)  (460.0-.9,  465. 0-. 9).  They 
were  selected  for  several  reasons.  1)  They 
are  widely  prevalent  conditions57  and  are 
thus  of  importance  for  populations  other 
than  Medicaid.  2)  They  accounted  for 
about  33  per  cent  of  all  ambulatory  care 
delivered  to  this  cohort  over  the  study  pe- 
riod, as  they  do  for  a  similarly  large  amount 
of  primary  care  in  the  country  as  a  whole.  3) 
The  number  of  episodes  of  these  diseases 
were  sufficient  to  permit  analyses  dis- 
aggregated by  physician  characteristics.  4) 
Relatively  simple  process  criteria  for  min- 
imal levels  of  quality  of  care  (along  the 
deliberately  narrow  dimensions  of  appro- 
priateness of  medications  and  laboratory 
tests)  could  be  established.  This  made 
quality-of-care  analyses  simpler  and  easier 
to  interpret,  while  still  being  powerful 
enough  to  detect  major  deficiencies  in 
care.  A  peer  review  organization  might 
wish  to  address  these  major  deficiencies 
first  before  looking  for  more  subtle  prob- 
lems. 5)  They  were  shown  in  earlier  work7 
to  have  been  associated  with  markedly 
different  patterns  of  injection  use  by 
provider  type. 

Variables 

Patient-specific  episodes  of  care  were 
created  that  encompassed  all  ambulatory 
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care  given  for  these  conditions  in  two  6- 
month  periods  two  years  apart.  (As  noted  in 
Chapter  I,  Period  I  in  these  analyses  was 
September  1971-February  1972;  Period 
II  the  same  months  two  years  later.) 

Differences  in  quality  of  care  according 
to  characteristics  of  the  physician  seen  in 
the  visit  that  began  an  episode  were  inves- 
tigated. The  structural  characteristics  were 
as  before:  type  of  practice  (group/solo), 
type  of  physician  training  (medical/ 
osteopathic),  board  certification  status, 
primary  care  specialty,  and  outlier  status. 

Simple  disease-specific  quality-of-care 
criteria  for  appropriate  use  of  antibiotic 
medications  in  both  injectable  and  oral 
form  were  developed  by  reference  to 
current  medical  and  pharmaceutical 
literature32,53, 59,88,90  and  up-to-date  texts 
and  handbooks  on  the  appropriate  use  of 
antibiotics,17,22'43,47,52,63  by  reference  to 
existing  quality-of-care  criteria  sets,  and  by 
obtaining  the  consensus  of  several  board- 
certified  physicians  in  internal  medicine 
and  pediatrics. 

The  X  entries  in  Table  6.1  specify  ap- 
propriate antibiotics  (or  no  antibiotics)  for 
the  diagnoses  listed;  entries  labeled  X 
were  considered  to  represent  at  least  min- 
imally acceptable  levels  of  care.  "No  an- 
tibiotics" was  considered  acceptable  in 
circumstances  when  there  were  good  rea- 
sons to  believe  1)  that  a  diagnosis  usually 
caused  by  a  bacterium  (e.g.,  strep  throat) 
was  being  used  as  a  "rule  out"  diagnosis,  as 
indicated  by  a  high  level  of  use  of  an  ap- 
propriate diagnostic  test  (such  as  a  throat 
culture  in  strep  throat),  or  2)  that  the  diag- 
nosis was  caused  by  a  virus  that  would  not 
respond  to  an  antibiotic  and  thus  should 
not  be  treated  with  one. 

Certain  diagnostic  tests  were  also 
specified  as  elements  of  good  quality  care 
for  these  diagnoses — for  instance,  throat  or 
strep  cultures  for  episodes  of  pharyngitis  or 
strep  throat.  In  addition,  at  least  1  revisit 
within  6  weeks  was  specified  as  an  ele- 
ment of  good  quality  for  episodes  of 
otitis  media. 


Data  Sources 

A  special  data  tape  produced  by  The 
Dikewood  Corporation  (the  EMCRO's  fis- 
cal intermediary)  contained  information 
coded  from  Medicaid  claim  forms  on  am- 
bulatory care  provided  to  AFDC  eligibles 
enrolled  continuously  from  September 
1971  to  August  1975.  It  covered  the  two 
6-month  periods  defined  above  and  was 
organized  chronologically  by  date  of  serv- 
ice (not  date  of  payment)  for  each  Medicaid 
eligible. 

Altogether,  the  tape  contained  about 
330,450  records  for  the  2  periods,  of  which 
59,570  were  ambulatory  visits  without  in- 
jections, 2,950  were  injections  without  vis- 
its, 18,350  were  visits  with  injections, 
225,075  were  prescription  drugs  and 
24,330  were  laboratory  tests.  These  data 
represented  care  for  approximately  21,550 
persons,  mostly  women  and  children,  as  is 
characteristic  of  an  AFDC  population. 

The  ambulatory  care  data  tape  contained 
the  following  items: 

1.  Ambulatory  visits. 

2.  Injections,  grouped  according  to  38 
separate  pharmacologic  groups.  A  code  in- 
dicating whether  the  EMCRO  denied 
payment  for  medical  reasons  was  given  for 
each  injection  in  a  record.  (Up  to  3  in- 
jections per  ambulatory  visit  were  listed  in 
each  record.) 

3.  All  prescription  drugs,  which  were 
coded  by  the  National  Drug  Code  with  in- 
formation about  manufacturer,  dosage, 
type  of  drug  and  by  a  special  therapeutic 
code  developed  by  Dr.  Richard  Atkinson  of 
the  New  Mexico  Department  of  Healdi 
and  Social  Services  for  the  EMCRO.  This 
therapeutic  code  had  about  150  different 
categories  such  as  specific  type  of  antibi- 
otic, cold  and  cough  preparations,  tran- 
quilizers, antidepressants,  and  so  forth. 

4.  Laboratory  tests  and  ambulatory 
diagnostic  procedures  selected  by  the  re- 
search team  for  their  relevance  for  the 
study  diagnoses;  these  excluded  services 
that  were  very  unlikely  to  be  associated 
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Table  6.1.    Criteria  for  Minimally  Acceptable  Antibiotic  Use,  by 
Type  of  Antibiotic  and  Diagnosis  (X  indicates  acceptable  use) 


Otitis  Media 

Appropriate  Pharyn-        Strep    Bron-       Acute  Influ- 

Antibiotic  Medication        gitis  Throat        Ages  0-4        Ages  5-7  chitis         URI  enza 


No  injectable  or 

oral  antibiotic 
Oral  antibiotics  only 
Penicillin 
Ampicillin  J 
Erythromycin 
Tetracycline" 
Cephalosporin 
Injectable  and  oral 

penicillin 
Injectable  and  oral 

ampicillin 
Injectable  bicillin  11 
Injectable  bicillin 
and  oral  sulfa 
Injectable  bicillin 

and  oral  ampicillin 


X 


X* 


X 


X 


xt 


X 

x§ 


X 
X 


Xf 

X 
X 
X 


X 
X 

X 

X 


X 

X 
X 
X 
X 
X 

X 

X 


*  Only  in  instances  when  the  rate  of  throat  culture  use  by  the  particular  physician  is  sufficiently  high  (s=  30 
per  cent  of  all  episodes)  that  we  could  reasonably  believe  1)  that  the  diagnosis  was  used  as  a  rule-out  and 
therefore  2)  that  the  probability  was  relatively  high  that  the  final  diagnosis  was  not  strep  throat,  based  on  the 
results  of  a  culture. 

t  Only  in  cases  of  chronic  (serous)  otitis  media,  which  is  not  infectious.  We  had  no  way  to  evaluate  whether 
otitis  media  was  infectious  or  not  from  these  claims  data;  thus,  this  therapeutic  option  was  permitted  for  all 
episodes. 

\  Amoxicillin,  a  new  antibiotic  not  used  by  the  physicians  in  this  study,  is  at  least  equivalent  to  if  not  better 
than  ampicillin. 

§  Erythromycin  plus  sulfa  would  also  be  appropriate. 
11  Ages  8  and  older  only. 

f  Here  and  elsewhere,  bicillin  refers  to  the  LA  penicillin  used  by  the  providers  studied. 


with  common  infectious  diseases,  such  as 
roentgenography  of  extremities. 

5.  Patient  information  (age,  sex,  race,  aid 
category,  county  of  residence). 

6.  Diagnosis:  up  to  2  diagnoses  were 
available  for  each  service  except  prescrip- 
tion drugs.  These  were  coded  according  to 
HICDA-I  codes. 

7.  Provider  linking  number  that 
specified  the  solo  physician  or  group  prac- 
tice who  gave  the  particular  service.  This 
allowed  a  link  to  be  made  to  information  on 
another  tape  about  the  structural  charac- 
teristics of  the  358  providers  (313  in  solo 
practice)  who  had  given  100  or  more  am- 
bulatory visits  to  Medicaid  enrollees  in  the 
first  2  years  of  EMCRO  operations.  These 
active  providers  delivered  more  than  80 
per  cent  of  the  ambulatory  care  to  the 
Medicaid  population  during  those  2  years. 


Data  available  on  physicians  in  solo  prac- 
tice included  age  (date  of  birth),  specialty 
in  which  they  claimed  to  practice,  county 
in  which  they  practiced,  country  of  medi- 
cal education  (United  States,  Canada,  or 
specific  foreign  country)  and  board  certifi- 
cation status.  Data  on  group  practices  in- 
cluded specialty,  whether  the  practice  was 
single-specialty  or  multispecialty,  county 
in  which  the  practice  was  located,  size  of 
the  practice  and  board  certification  status 
of  the  members.  Complete  data  were  avail- 
able for  about  95  per  cent  of  these  provid- 
ers; most  missing  data  concerned  certifica- 
tion status,  especially  for  physicians  in 
group  practice. 

We  aggregated  laboratory  tests  and  pre- 
scription drugs  into  categories  meaningful 
for  these  specific  diagnoses.  Thus, 
analyses  focused  on  16  categories  of  oral 


66 


antibiotics  and  12  categories  of  injectable 
antibiotics  (Table  6.2),  where  the  combina- 
tions were  chosen  empirically  because  of 
frequency  of  use  in  Period  I.  (In  judging 
quality  of  care,  "no  antibiotic  injection" 
and  "no  oral  antibiotic"  were  included  as 
possible  therapies.) 

Creation  of  Disease-Specific  Episodes 

The  methodologic  issues  considered  in 
developing  disease-specific  episodes  of 
care  included  specifying  an  optimal  length 
of  time  for  the  episode  and  articulating 
explicit  rules  to  assign  services  to  episodes 
when  they  belonged  and  to  exclude  serv- 
ices when  they  did  not  belong  but  occurred 
within  the  specified  time  frame.  For  these 
respiratory  conditions,  episodes  were  con- 
sidered on  clinical  grounds  to  last  possibly 
longer  than  1  week  but  typically  not  longer 
than  4  weeks.  Between  these  extremes,  an 
empirical  approach  (described  below)  was 
used  to  select  an  appropriate  length  of 
time;  2  weeks  was  the  period  finally  cho- 
sen. (The  only  exception  to  this  was  in  re- 
visits for  people  with  otitis  media,  for 
which  6  weeks  was  used.) 

To  assign  each  physician  visit,  laboratory 
test  or  injection  to  1  and  only  1  of  the  2 
diagnoses  that  could  appear  on  a  claim 
form,  a  set  of  ranking  rules  was  established 
that  specified  a  hierarchy  from  diagnoses 
with  a  clearly  bacterial  origin  (e.g.,  strep 
throat)  to  those  that  were  more  likely  viral 
in  etiology  (e.g.,  acute  URI)  (see  Table  5. 1). 
The  higher  ranking  of  any  2  diagnoses  on  a 
claim  form  was  considered  the  one  most 
likely  to  be  appropriately  treated  with  an 
antibiotic  or  the  one  most  likely  to  require  a 
specific  laboratory  test;  hence,  the  higher- 
ranking  diagnosis  was  used  whenever  a 
service  could  be  assigned  to  more  than  1 
diagnosis.  This  had  the  effect — which  was 
intended — of  giving  the  physician  the 
benefit  of  the  doubt  in  justifying,  for  in- 
stance, the  use  of  antibiotics. 

For  each  patient,  an  episode  was  con- 
sidered to  have  begun  with  a  visit  for  the 
specific  diagnosis  and  to  continue  for  2,  3 


Table  6.2.    Combinations  of  Injectable 
and  Oral  Antibiotics  Used  in 
Episode  Analyses* 


Injectable  Antibiotics 

Oral  Antibiotics 

Wo  anti  nioHp 

Wo  i^ntiniotip 

i  ^  w  ex  i  hi  i  J  i  v  f  ijv- 

injection 

prescription 

Penicillin 

Ampicillin 

T  ,  i  n  pom  vci  n 

Ppn  nil  lo  ^nori  n 

V— '  t  ±Jl  ld-1  \J  O  yJ\J  t  111 

Ampicillin 

E  rythromycin 

Tetracycline 

Tetracycline 

R  i  p  i  1 1  in 

k-f  IV    II!  Ill 

Ppn  ipi  1 1  i  n 

X  v    1111.  111111 

T  ,i n pom vr* in  vt  \ n s 

1  j  IIIV  V./ Ill  y  VIII     L_/ 1  \JL  J 

T.incomvpin 

»  1 1  ijv  v f  in  y  '    i  i  j 

npniri  11  in  t 

Sulfa 

Penicillin  plus 

Ampicillin  plus 

tetracycline 

tetracycline  $ 

Lincomycin  plus 

Ampicillin  plus 

te  tracycl  i  ne 

penicillin 

Bicillin  plus 

Penicillin  plus 

penicillin 

tetracycline 

Dicniin  pius 

Tetracycline  plus 

lincomycin 

sulfa 

Ampicillin  plus 

Penicillin  plus 

penicillin  • 

sulfa 

Erythromycin  plus 

penicillin 

Erythromycin  plus 

tetracycline 

Erythromycin  plus 

sulfa 

*  A  combination  is  1  entry  from  the  first  column 
plus  1  entry  from  the  second  column,  yielding  192 
(12  x  16)  unique  combinations. 

t  Means  that  both  a  lincomycin  and  penicillin  in- 
jection were  given  in  the  episode. 

\  Means  that  both  an  ampicillin  and  tetracycline 
prescription  were  filled  in  the  episode. 

or  4  weeks  thereafter.  For  each  diagnosis- 
specific  episode,  all  visits,  laboratory  tests, 
injections  and  prescription  drugs  occur- 
ring in  the  relevant  time  frames  were 
examined  to  determine  whether  the  ser- 
vice was  given  for  the  specific  diagnosis 
under  study,  for  a  different  but  related  in- 
fectious disease  diagnosis  (for  example,  the 
remaining  5  of  the  6  being  studied, 
sinusitis,  pneumonia,  etc.)  or  all  other 
diagnoses  (see  Appendix  A,  Tables  1-5). 
For  example,  using  the  2-week  time  frame 
and  assuming  that  a  visit  for  acute  URI 
began  an  episode  of  acute  URI,  services 
that  occurred  within  the  ensuing  2  weeks 
were  counted  separately  according  to 
whether  they  were  for  URI,  another  infec- 
tious disease  or  any  other  illness. 
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The  decision  as  to  the  optimal  time  pe- 
riod for  an  episode  was  made  by  reference 
to  the  following  criteria:  1)  the  percentage 
of  services  occurring  within  the  time  frame 
that  were  related  to  the  specific  diagnosis 
under  study  (as  opposed  to  any  other  diag- 
noses) was  as  high  as  possible;  2)  the 
number  of  revisits  or  laboratory  tests  for  the 
specific  diagnosis  under  study  missed  by 
making  the  episode  too  short  were  as  few 
as  possible;  and  3)  all  other  things  equal, 
the  number  of  episodes  within  the  study 
period  should  be  as  high  as  possible. 

Based  on  these  criteria,  all  of  which,  of 
course,  cannot  be  optimized  simultane- 
ously, the  uniformly  preferable  period  of 
time  for  an  episode  of  illness  for  the  respi- 
ratory diseases  studied  was  2  weeks.  The 
highest  percentages  of  all  visits,  laboratory 
tests,  prescriptions  and  injections  occur- 
ring within  the  specific  time  frame  were 
assigned  to  the  diagnosis  defining  the 
episode  when  the  2-week  specification 
was  used  (see  Appendix  A,  Tables  1-5). 
Increasing  the  length  of  the  episode 
increased  the  likelihood  that  a  second 
disease  process  would  be  encountered. 

In  addition,  even  when  the  episode 
length  was  increased  from  2  to  4  weeks  and 
it  was  assumed  that  all  additional  services 
given  for  the  diagnosis  defining  the 
episode  belonged  in  it  (rather  than  in  a 
different  episode  of  the  same  diagnosis), 
the  increase  in  services  was  not  remark- 
able and  would  not  have  meaningfully  af- 
fected judgments  about  levels  of  quality  of 
care.  As  examples  (Table  6.3),  when  the 
episode  length  was  doubled  (i.e.,  from  2  to 
4  weeks),  the  number  of  visits  per  episode 
went  from  1.19  to  1.26  for  otitis  media,  the 
number  of  laboratory  tests  per  episode  of 
pharyngitis  did  not  change  (0.14  per 
episode),  the  number  of  antibiotic  pre- 
scriptions per  episode  of  acute  URI  went 
from  0.51  to  0.58,  and  the  number  of  an- 
tibiotic injections  for  influenza  from  0.54  to 
0.58.  Finally,  as  would  be  expected,  the 
2-week  specification  resulted  in  the  iden- 
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tification  of  a  substantially  higher  number 
of  episodes. 

A  hypothetical  example  of  the  construc- 
tion of  an  episode  is  presented  in  Table  6.4. 
For  each  patient,  an  episode  was  consid- 
ered to  begin  with  a  visit  for  a  specific 
diagnosis  and  to  continue  for  2  weeks 
thereafter.  All  visits,  laboratory  tests,  injec- 
tions, and  prescription  drugs  occurring  in 
the  relevant  time  frame  were  assigned 
either  to  the  diagnosis  under  study  or  to 
another  diagnosis  by  a  specific  set  of  al- 
gorithms. So  as  not  to  confound  the 
analyses  with  partial  episodes,  episodes 
were  constrained  to  begin  at  least  2  weeks 
after  the  start  of  Period  I  or  Period  II  and 
not  to  begin  within  2  weeks  of  the  end  of 
each  period.*  A  set  of  rules  was  developed 
to  handle  combinations  of  both  oral  and 
injectable  antibiotics  (separately  and  to- 
gether), which  accounted  for  the  use  of 
pairs,  triplets,  and  higher-level  combina- 
tions of  antibiotics.  These  rules  resulted  in 
assigning  each  episode  to  1  and  only  1  of 
the  12  antibiotic  injection  categories  and  to 
1  and  only  1  of  16  oral  antibiotic  categories 
and  then  to  1  of  192  (12  x  16)  possible 
combinations  (see  Table  6.2).  Diagnoses 
were  not  specified  on  prescription  claim 
forms.  To  assign  prescription  drugs  to  a 
specific  diagnosis,  the  following  algorithm 
was  developed:  within  the  time  frame  of 
the  episode,  the  prescription  was  assigned 
to  the  diagnosis  of  the  first  (initiating)  visit 
if  no  other  visit  with  a  different  diagnosis 
intervened  between  the  first  visit  and  the 
prescription.  The  prescription  was  as- 
signed to  the  diagnosis  of  the  intervening 
visit  if  that  diagnosis  was  different  from  the 
initial  one.f  The  analyses  reported  below 

*  A  2-week  specification  for  an  episode  can  produce 
a  larger  number  of  episodes  than  a  longer  specifica- 
tion, because  of  the  total  period  of  time  in  which  an 
episode  can  occur.  For  example,  if  a  2-week  time  span 
is  used,  only  2  weeks  are  lost  at  the  beginning  and 
another  2  weeks  at  the  end  of  the  6-month  period,  for  a 
total  of  one-sixth  of  the  entire  period,  compared  with  4 
weeks  at  each  end,  or  one-third  of  the  entire  period  if  a 
4-week  time  span  is  used. 

f  This  same  rule  was  used  in  assigning  laboratory 


are  based  on  episodes  containing  only 
those  services  and  medications  with  the 
diagnosis  under  study  or  another  related 
infectious  disease  diagnosis  |;  services  and 
medications  given  for  "other"  diagnoses, 
even  though  they  occurred  within  the 
episode  time  period,  were  not  assigned  to 
the  episodes. 

Analyses 

Once  episodes  were  created,  they  were 
assigned  to  the  physician  providing  the  ini- 
tial visit  and  an  assessment  of  the  quality  of 
care  was  made  for  subsets  of  physicians 
distinguished  by  the  structural  characteris- 
tics noted  earlier.  The  quality-of-care 
judgment  was  based  on  the  criteria  relating 
to  use  of  antibiotics  given  in  Table  6.1  and 
the  frequency  with  which  a  relevant  labo- 
ratory test  was  performed.  The  following 
are  the  major  computation  and  compari- 
sons carried  out:  1)  the  percentage  of 
episodes  in  both  Period  I  and  II  that  each 
category  of  provider  treated  correctly;  2)  a 
comparison  of  the  percentages  of  episodes 
treated  correctly  by  physician  type  for  each 
period — i.e.,  a  measure  of  the  differences 
in  quality  of  care  as  a  function  of  physician 
characteristics;  and  3)  a  comparison  of  the 
percentages  of  episodes  treated  correctly 
in  Periods  I  and  II — i.e.,  a  measure  of  the 
change  over  time  in  quality  of  care  pre- 
sumably produced  by  the  New  Mexico 
peer  review  system. 


tests  to  episodes  even  though  claim  forms  for  labora- 
tory tests  often  had  an  associated  diagnosis.  Using  the 
prescription  rule  slightly  increased  the  number  of 
laboratory  tests  assigned  to  an  episode  (see  Appendix 
A,  Tables  2  and  3).  As  will  be  seen  later,  laboratory 
tests  were  not  done  very  often  in  this  Medicaid  cohort 
and  the  adoption  of  this  rule  was  in  line  with  our 
desire  to  give  the  physician  the  benefit  of  the  doubt. 
Under  other  circumstances,  using  a  different  rule  may 
be  preferable. 

\  For  purposes  of  these  analyses  concerning  respi- 
ratory tract  infections,  a  related  infectious  disease  was 
any  of  the  6  diseases  under  study  (other  than  the  1 
being  studied  at  the  moment)  or  any  other  illness  of 
any  portion  of  the  respiratory  tract  as  listed  in  Table 
5. 1  (such  as  pneumonia). 
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Table  6.4.    Construction  of  an  Episode  Using  a  Maximum 
Length  of  2  Weeks 


LT,  V,  I,       Vs       P      V0      P'  P  

Day  -3       Day  1  Day  14  Day  16 

Time 


V/ :  Visit  beginning  an  episode. 

Ys :  Visit  for  same  diagnosis  or  another  related  infectious  disease  within  2  weeks;  assigned  to  episode  and 
counted  as  a  revisit. 

V0 :  Visit  for  noninfectious  diagnosis  or  nonrelated  infectious  disease  within  2  weeks;  not  assigned  to 
episode  and  not  counted  as  a  revisit. 
LT, :  Laboratory  test,  same  diagnosis,  preceding  initial  visit  of  episode;  not  assigned  to  episode. 
I, :  Injection  with  same  diagnosis,  within  2  weeks;  assigned  to  episode. 
P:  Prescription  within  2  weeks;  assigned  to  episode. 

P':  Prescription  within  2  weeks  following  a  visit  for  a  noninfectious  diagnosis;  not  assigned  to  episode. 
P":  Prescription  not  within  two  weeks;  not  assigned  to  episode. 


Results 

The  results  are  presented  in  the  follow- 
ing order. 

1.  Distribution  of  the  number  of 
diagnosis-specific  episodes  by  provider 
type. 

2.  Distribution  of  the  antibiotics  used  in 
Periods  I  and  II  to  treat  the  diagnosis- 
specific  episodes. 

3.  Discussion  of  quality  of  care  provided 
for  each  diagnosis  as  judged  by  the 
criteria  for  antibiotic  use  that  reflect  at 
least  minimal  care.  (In  addition,  Appen- 
dix B,  Tables  6A-13B  contain  the 
specific  types  of  antibiotics  and  combi- 
nations of  antibiotics  used  by  each  pro- 
vider type  in  approximately  90  per  cent 
of  all  episodes  for  each  diagnosis.)  This 
assessment  of  the  quality  of  antibiotic 
use  includes  a  comparison  among  pro- 
vider types  as  to  whether  statistically 
significant  differences  were  observed  in 
the  percentage  of  disease-specific 
episodes  treated  appropriately  and  an 
examination,  within  each  provider  type, 
of  whether  the  quality  of  care  improved 
significantly  between  Periods  I  and  II. 

4.  Selected  additional  analyses  done  on 
the  use  of  tetracycline  in  children  less 
than  8  years  old,  multiple  classes  of  an- 
tibiotics, lincomycin,  and  all  antibiotics 
by  primary  care  specialty. 

5.  Discussion  of  the  use  of  selected  diag- 
nostic procedures  (throat  and  strep  cul- 
tures, white  blood  counts,  and  chest 


roentgenography).  The  focus  is  on  gen- 
eral patterns  of  use  of  laboratory  tests, 
differences  among  provider  types 
within  each  period,  and  differences  be- 
tween the  2  periods  for  each  provider 
type. 

In  the  quality-related  analyses,  tabular 
information  is  in  the  form  of  the  percen- 
tages of  diagnosis-  and  provider-specific 
episodes  that  were  associated  with  a 
specified  pattern  of  medication  or  labora- 
tory use.  In  all  tables  in  this  section,  figures 
for  disaggregated  provider  types  do  not 
add  to  the  subtotals  for  group  practices, 
medical  doctors  (MDs)  and  doctors  of  os- 
teopathy (DOs)  because  providers  of  un- 
known certification  status  were  included 
in  the  subtotals,  and  subtotals  do  not  add  to 
the  total  because  medical  facilities  with  no 
resident  physician  were  included  in  the 
total.  In  all  cases,  the  numbers  of  episodes 
seen  by  the  "excluded"  physician 
categories  were  small.  Unless  otherwise 
specified,  the  noncertified  categories  in- 
clude outliers,  as  all  outliers  were  noncer- 
tified. All  tables  in  this  section  refer  only  to 
services  provided  by  the  358  providers 
discussed  in  earlier  chapters.  All  discus- 
sion of  the  use  of  injections  or  oral  prescrip- 
tion drugs  refers  only  to  antibiotics,  and  all 
discussion  of  injections  refers  only  to  the 
use  of  intramuscular  (IM)  injections. 
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As  noted  above,  quality-of-care  criteria 
with  respect  to  antibiotic  use  in  these  dis- 
eases are  specified  in  Table  6.1.  In  the  case 
of  strep  throat  and  otitis  media,  the  mini- 
mal criteria  included  the  possibility  that  no 
antibiotic  was  an  acceptable  therapy.  For 
strep  throat,  that  criterion  was  conditional 
on  whether  the  number  of  throat  or  strep 
cultures  was  sufficiently  high  (s=  30  per 
cent  of  all  strep  throat  episodes  seen  by  that 
provider  type)  to  justify  concluding  that  the 
diagnosis  of  strep  throat  was  being  used  as 
a  "rule-out"  pending  the  result  of  the  cul- 
ture (which  could,  of  course,  show  no  strep 
infection).  For  otitis  media,  some  episodes 
could  reflect  serous  otitis  media,  which 
may  not  require  an  antibiotic.  "No  antibi- 
otic therapy"  was  listed  as  the  only  accept- 
able therapy  for  acute  URI  and  influenza 
because,  given  the  algorithms  by  which 
services  and  visits  were  aggregated  hierar- 
chically into  episodes,  these  episodes  were 
very  unlikely  to  have  a  bacterial  etiology. 

The  quality-of-care  criteria  for  laboratory 
work  were  based  on  the  argument  that  at 
least  a  minimal  level  of  throat  or  strep  cul- 
tures (especially  in  children  with  a  "sore 
throat")  are  necessary  to  make  the  diag- 
nosis of  strep  throat  accurately  and,  de- 
pending on  the  results  of  the  culture,  to 
prevent  either  the  complications  of  that 
disease  (by  treating  it)  or  the  unnecessary 
use  of  antibiotics  in  children  who  have  a 
viral  infection  (see  the  literature  review  in 
Chapter  IV).  Finally,  a  chest  roentgeno- 
gram is  an  acceptable  service  in  at  least 
some  people  with  bronchitis.  Its  use  can  be 
considered  at  least  reasonable,  but  is  by  no 
means  required,  for  all  patients  with 
bronchitis. 

We  did  2  sets  of  tests  of  statistical  signifi- 
cance (using  a  t-test  for  the  differences  in 
means  of  2  independent  samples).  The  first 
test  was  to  determine  the  level  of  signifi- 
cance of  differences  in  the  quality  of  care 
between  the  group  practices^  on  the  one 


§  This  included  both  certified  and  noncertified 
groups.  Certified  groups  were  those  in  which  most,  if 


hand  and  the  separate  medical  and  os- 
teopathic solo  provider  categories  on  the 
other.  This  was  done  for  each  diagnosis  in 
each  time  period.  The  second  set  of  tests 
was  done  to  determine  the  level  of  signifi- 
cance in  the  change  in  quality  of  care  be- 
tween Period  I  and  Period  II  for  each  dis- 
ease and  provider  type.  All  reported  levels 
of  significance  are  for  a  one-tailed  test;  the 
hypotheses  were  that  group  practices  pro- 
vided higher  levels  of  quality  of  care  than 
all  categories  of  solo  providers  and  that 
Period  II  figures  for  quality  of  care  were 
higher  than  those  from  Period  I. 

Distribution  of  Diagnosis- 
Specific  Episodes 

The  distribution  of  episodes  by  type  of 
disease  clearly  differed  by  physician  type 
(solo  or  group  practice,  certified  and  non- 
certified  MDs  and  DOs,  and  outlier  status) 
(Table  6. 5). 11  The  following  are  striking 
examples  from  Period  I.  For  bronchitis 
episodes,  DOs  saw  63  per  cent  and  group 
practices  only  4  per  cent;  the  figures  for 
otitis  media  were  41  and  20  per  cent,  re- 
spectively. MDs  saw  52  per  cent  of  all 
pharyngitis  episodes  and  29  per  cent  of  all 
episodes  of  strep  throat.  In  Period  I  DOs 
saw  the  largest  fraction  of  episodes  of  all 
diagnoses  except  pharyngitis.  Noncertified 
DOs  (excluding  outliers)  saw  a  larger  por- 
tion of  these  episodes  than  any  other 
specific  type  of  physician,  but  this  propor- 
tion varied  by  disease.  Noncertified  DOs 


not  all,  members  were  board-certified;  as  noted  ear- 
lier, the  majority  of  group  practice  episodes  were  seen 
by  2  larger  multispecialty  clinics  in  which  virtually  all 
members  were  certified. 

11  We  cannot  disprove  the  contention  that  these  dif- 
ferences were  partially  or  entirely  systematic  varia- 
tions in  the  choice  of  a  diagnostic  classification  for  the 
same  condition  across  the  different  physician 
categories — e.g.,  what  one  category  might  typically 
call  influenza  another  might  typically  call  acute  URI. 
However,  as  noted  in  the  Discussion  below,  systema- 
tic biases  in  diagnosis  specification  were  unlikely  to 
be  a  major  problem  in  testing  the  hypotheses  stated 
above,  especially  those  regarding  changes  over  time. 
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saw  34  per  cent  of  the  bronchitis  episodes 
and  24  per  cent  of  the  pharyngitis  episodes. 

The  distribution  of  episodes  by  provider 
type  was  different  in  Period  II.  MDs  saw 
the  largest  portion  of  episodes  of  acute  URI 
and  influenza  in  Period  II.  Group  practices 
saw  a  larger  fraction  of  the  strep  throat 
episodes  in  Period  II  compared  with  Pe- 
riod I  (34  per  cent  compared  with  24  per 
cent);  this  increase  was  accounted  for  by 
noncertified  groups.  A  smaller  proportion 
of  strep  throat  episodes  was  seen  by  MDs 
(virtually  all  of  the  decrease  being  among 
outliers).  Among  DOs,  outliers  saw  a 
higher  fraction  of  strep  throat  episodes  in 
Period  II,  and  noncertified  DOs  other  than 
outliers  a  smaller  fraction. 

Overall  Use  of  Antibiotics  in  Disease- 
Specific  Episodes 

Table  6.6  describes  the  patterns  of  an- 
tibiotic use  for  these  6  conditions  aggre- 
gated over  all  physician  types.  The 
disease-by-disease  text  below  focuses  only 
on  the  percentage  of  episodes  receiving 
any  antibiotic  in  either  oral  or  injectable 
form,  striking  differences  by  physician 
type  in  disease-specific  use  of  types  of 
antibiotics,  and  important  shifts  between 
Periods  I  and  II.  The  reader  is  referred  to 
Appendix  B,  Tables  6A-13B,  for  detailed 
information  on  patterns  of  antibiotic  use  by 
provider  category. 

Strep  Throat  (Appendix  B,  Tables  6A, 
6B).  Of  the  363  episodes  of  strep  throat  in 
Period  I  that  were  treated  by  the  358  pro- 
viders considered  in  this  study,  76  per  cent 
involved  use  of  some  antibiotics:  35  per 
cent  of  episodes  treated  by  group  prac- 
tices,* 79  per  cent  of  those  treated  by  MDs 
and  95  per  cent  of  those  treated  by  DOs. 
Fifty-eight  per  cent  of  all  patients  widi 
strep  throat  received  IM  antibiotics,  55  per 


#  This  low  percentage  was  accompanied  by  a  high 
use  of  throat  cultures  and  most  likely  reflects  the  use 
of  this  label  as  a  presumptive  diagnosis  pending  the 
result  of  a  throat  culture. 


cent  oral  antibiotics.  In  Period  II,  the  per- 
centage of  the  461  episodes  treated  with 
antibiotics  was  83  per  cent:  70  per  cent  of 
episodes  treated  by  group  practices,*  86 
per  cent  of  those  treated  by  M  Ds  and  93  per 
cent  of  those  treated  by  DOs.  Sixty-five  per 
cent  of  all  patients  received  IM  antibiotics, 
61  per  cent  oral  antibiotics.  The  most 
marked  change  in  patterns  of  use  (see 
Table  6.6)  was  the  shift  to  injectable  LA 
penicillin  with  or  without  the  use  of  oral 
antibiotics.  Some  drop  in  use  of  IM  SA 
penicillin  occurred  except  when  it  was 
given  with  oral  penicillin. 

Pharyngitis  (Appendix  B,  Tables  7A, 
7B).  Of  the  2,133  pharyngitis  episodes  in 
Period  I,  83  per  cent  of  the  episodes  in- 
volved use  of  antibiotics:  44  per  cent  of 
those  treated  by  group  practices,  81  per 
cent  of  those  treated  by  MDs  (outliers,  91 
per  cent)  and  94  per  cent  of  those  treated  by 
DOs  (outliers,  98  per  cent).  Fifty-seven  per 
cent  of  these  episodes  involved  IM  an- 
tibiotics, 63  per  cent  oral  antibiotics.  In 
Period  II,  of  2,067  episodes,  77  per  cent 
involved  antibiotics:  45  per  cent  of  those 
treated  by  group  practices,  80  per  cent  of 
those  treated  by  MDs  and  85  per  cent  of 
those  treated  by  DOs;  29  per  cent  of  the 
episodes  involved  IM  antibiotics,  65  per 
cent  oral. 

The  most  notable  features  found  in 
examination  of  antibiotic  use  for  episodes 
of  pharyngitis  by  provider  type  included 
the  following  (see  also  Table  6.6):  1)  In 
Period  I,  in  30  per  cent  or  more  of  all 
pharyngitis  episodes,  patients  received  in- 
jectable SA  penicillin  alone  or  in  combina- 
tion with  other  antibiotics;  by  Period  II, 
this  figure  had  dropped  to  about  4  per  cent. 
In  contrast,  patients  received  only  oral 
penicillin  in  8  per  cent  of  the  episodes  in 
Period  I;  17  percent  in  Period  II.  2)  Inject- 
able LA  penicillin  with  no  oral  antibiotic 
was  used  almost  exclusively  among  group 
practices  in  Period  I;  its  use  increased  in 
Period  II,  largely  among  DOs.  Interest- 
ingly, injectable  LA  penicillin  with  several 
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types  of  oral  antibiotics  (ampicillin,  lin- 
comycin  or  penicillin)  was  also  used  in  Pe- 
riod II;  the  combination  with  ampicillin 
was  observed  among  MD  outliers  and  the 
combination  with  lincomycin  among  DO 
outliers.  3)  Use  of  oral  ampicillin  alone 
(which  was  considered  not  an  acceptable 
therapy  for  pharyngitis  because  the  side 
effects  of  ampicillin  are  greater  than  those 
for  penicillin)  nearly  doubled  between  the 
2  periods  (from  6  to  12  per  cent  of  all 
episodes).  4)  In  Period  I,  use  of  injectable 
lincomycin  was  concentrated  almost  en- 
tirely among  outlier  DOs  (e.g.,  injectable 
lincomycin  with  no  oral  antibiotic  was 
used  in  22  per  cent  of  pharyngitis  episodes 
treated  by  them).  5)  A  wide  variety  of  inap- 
propriate or  questionable  IM  and  oral  an- 
tibiotic combinations  was  used  in  Period  I, 
including  injectable  lincomycin  with  oral 
erythromycin,  oral  ampicillin,  or  oral 
penicillin  (nearly  exclusively  by  DOs)  and 
injectable  LA  penicillin  with  oral  sulfa  or 
tetracycline.  In  general,  use  of  lincomycin 
and  the  inappropriate  antibiotic  combina- 
tions (excluding  the  LA  penicillin  combi- 
nations noted  above)  disappeared  by  Pe- 
riod II. 

Otitis  Media  (Appendix  B,  Tables  8A, 
8B,  9A,  9B).  Because  indicated  or  con- 
traindicated  types  of  antibiotics  for  otitis 
media  differ  according  to  age,  we  dis- 
aggregated episodes  for  children  ages  4 
and  younger,  5  through  7,  and  8  and  older. 
Because  sample  sizes  were  so  small  for  the 
oldest  group,  those  findings  are  not  re- 
ported here. 

Of  the  393  episodes  of  otitis  media 
among  children  4  years  of  age  and  younger 
in  Period  I,  the  proportion  of  episodes  in 
which  patients  received  antibiotics  was  81 
per  cent:  group  practices,  66  per  cent; 
MDs,  82  per  cent;  and  DOs,  92  per  cent.  Of 
the  150  episodes  in  the  same  age  group  in 
Period  II,  the  figure  was  77  percent:  group 
practices,  48  per  cent;  MDs,  88  per  cent; 
and  DOs,  89  per  cent.  Among  children  5  to 
7  years  old,  the  proportions  of  episodes  in 
which  patients  received  antibiotics  were 


somewhat  lower  than  for  the  younger  age 
group.  In  Period  I,  75  per  cent  of  156 
episodes  received  antibiotics:  group  prac- 
tices, 33  per  cent;  MDs,  76  per  cent;  and 
DOs,  92  per  cent.  The  figures  for  the  106 
episodes  in  Period  II  were  78  per  cent 
overall:  group  practices,  50  per  cent;  MDs, 
82  per  cent;  and  DOs,  84  per  cent. 

Two  notable  patterns  were  observed 
(see  Table  6.6):  Use  of  oral  ampicillin  alone 
remained  constant  for  children  5-7  years 
old  and  increased  for  children  younger 
than  4  years.  Use  of  injectable  LA  penicil- 
lin alone  or  with  ampicillin  increased 
markedly  in  both  groups. 

Bronchitis  (Appendix  B,  Tables  10A, 
10B).  Of  the  1,637  episodes  of  bronchitis  in 
Period  I,  79  per  cent  involved  antibiotics; 
the  range  of  episodes  in  which  antibiotics 
were  used  was  from  37  per  cent  for  group 
practices  to  96  per  cent  for  outlier  DOs.  In 
49  per  cent  of  all  bronchitis  episodes,  pa- 
tients received  IM  antibiotics;  in  62  per 
cent,  oral  antibiotics. 

Of  the  1,111  episodes  of  bronchitis  in 
Period  II,  65  per  cent  involved  use  of  an- 
tibiotics: 46  per  cent  of  episodes  treated  by 
group  practices,  59  per  cent  of  those  treated 
by  MDs,  71  per  cent  of  those  treated  by 
DOs  and  81  per  cent  of  those  treated  by  DO 
outliers.  Altogether,  11  per  cent  involved 
IM  antibiotics;  62  percent,  oral  antibiotics. 

Some  use  of  injectable  SA  penicillin 
alone  was  observed  in  Period  I  (see  Table 
6.6),  principally  among  MD  outliers.  IM 
lincomycin  with  or  without  an  oral  antibi- 
otic was  used  in  approximately  29  per  cent 
of  all  DO  episodes,  and  oral  lincomycin 
without  injectable  lincomycin  in  another  5 
per  cent  of  DO  episodes.  The  highest  use 
of  lincomycin  was  among  DO  outliers,  who 
treated  about  two-thirds  of  their  bronchitis 
episodes  with  lincomycin. 

The  range  of  injectable  and/or  oral  an- 
tibiotics used  in  bronchitis  was  substan- 
tially reduced  by  Period  II.  As  with  the 
preceding  diagnoses,  use  of  lincomycin  in 
any  form  nearly  disappeared  by  Period  II. 
In  addition,  the  use  of  injectable  SA 
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Table  6.5.    Distribution  of  Episodes  by  Type  of  Provider, 
Diagnosis  and  Period 


Strep  Throat  Otitis  Media  Pharyngitis 


Period  I         Period  II  Period  I         Period  II  Period  I         Period  II 


Type  of  Per  Per  Per  Per  Per  Per 

Provider  No.    Cent      No.    Cent        No.    Cent      No.    Cent        No.    Cent      No.  Cent 


Group* 

88 

24 

157 

34 

169 

20 

99 

19 

183 

9 

267 

13 

Noncertified 

4 

1 

77 

17 

24 

3 

29 

6 

17 

1 

92 

4 

Certified 

71 

21 

61 

13 

131 

16 

60 

12 

129 

6 

118 

6 

MD* 

106 

29 

80 

17 

317 

38 

203 

39 

1,105 

52 

975 

47 

Outlierf 

53 

15 

14 

3 

67 

8 

29 

6 

374 

18 

328 

16 

Noncertifiedf 

31 

9 

37 

8 

128 

15 

76 

15 

480 

23 

399 

19 

Certified 

20 

6 

26 

6 

117 

14 

89 

17 

228 

11 

211 

10 

DO* 

169 

47 

224 

48 

344 

41 

209 

41 

819 

38 

800 

39 

Outlierf 

47 

13 

130 

28 

51 

6 

23 

4 

187 

9 

163 

8 

Noncertified| 

104 

29 

78 

17 

224 

27 

160 

31 

502 

24 

543 

26 

Certified 

5 

1 

16 

3 

59 

7 

26 

5 

115 

5 

94 

5 

Total  § 

363 

461 

830 

511 

2,133 

2,067 

Grand  Total 

368 

482 

898 

581 

2,250 

2,220 

*  Includes  episodes  seen  by  facilities  with  no  resident  physician  or  by  providers  with  unknown  certifica- 
tion status. 

f  Outliers  are  a  separate  (noncertified)  category  for  MDs  and  DOs. 
$  Note  that  outliers  are  excluded  from  these  rows. 

§  Includes  only  episodes  seen  by  the  358  providers  who  gave  more  than  100  ambulatory  visits  in  the  first  2 
years  of  the  study. 


penicillin  with  no  oral  antibiotic  dropped 
by  Period  II. 

Influenza  (Appendix  B,  Tables  11A, 
11B).  The  number  of  episodes  of  influenza 
among  all  ages  in  Periods  I  and  II  was 
relatively  small.  Of  the  502  influenza  epi- 
sodes in  Period  I,  71  per  cent  involved  anti- 
biotics: group  practices,  22  per  cent;  MDs, 
64  per  cent;  and  DOs,  86  per  cent.  Forty- 
five  per  cent  involved  IM  antibiotics; 
50  per  cent,  oral  antibiotics.  Of  the  305 
episodes  in  Period  II,  53  per  cent  involved 
antibiotics:  group  practices,  40  per  cent; 
MDs,  50  per  cent;  and  DOs,  63  per  cent. 
Fourteen  per  cent  of  all  influenza  episodes 
in  Period  II  received  IM  antibiotics;  48  per 
cent,  oral  antibiotics.  As  with  all  other 
diagnoses,  the  use  of  lincomycin  (in  either 
injectable  or  oral  form)  was  markedly  re- 
duced by  Period  II  (Table  6.6). 


Acute  URI  (Appendix  B,  Tables  12A, 
12B).  Of  the  2,106  episodes  of  acute  URI  in 
Period  I,  64  per  cent  received  antibiotics: 
group  practices,  22  per  cent;  MDs,  57  per 
cent;  and  DOs,  86  per  cent.  Thirty-eight 
per  cent  received  IM  antibiotics;  49  per 
cent,  oral  antibiotics.  In  Period  II,  of  1,363 
episodes,  49  per  cent  involved  antibiotics: 
group  practices,  19  per  cent;  MDs,  48  per 
cent;  and  DOs,  62  per  cent.  Eight  per  cent 
received  IM  antibiotics;  45  per  cent,  oral 
antibiotics. 

In  Period  I,  use  or  nonuse  of  antibiotic 
medications,  as  well  as  the  type  and 
number  of  antibiotics  selected,  varied  by 
provider  type.  For  example,  among  the 
group-practice  acute  URI  episodes  that  re- 
ceived some  antibiotic  medication,  the 
principal  choices  were  oral  antibiotics  or 
injectable  SA  or  LA  penicillin.  MD  and 
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TABLE  6.5.  Continued. 


Bronchitis  Acute  URI  Influenza 


Period  I  Period  II  Period  I  Period  II  Period  I  Period  II 


Per  Per  Per  Per  Per  Per 

No.     Cent         No.     Cent  No.     Cent         No.     Cent  No.     Cent         No.  Cent 


69 

4 

62 

6 

325 

15 

170 

12 

46 

9 

38 

12 

21 

1 

40 

4 

53 

3 

54 

4 

14 

3 

10 

3 

42 

3 

19 

2 

211 

10 

85 

6 

28 

6 

14 

5 

540 

33 

380 

34 

826 

39 

670 

49 

186 

37 

151 

50 

135 

8 

88 

8 

129 

6 

159 

12 

59 

12 

71 

23 

244 

15 

184 

17 

388 

18 

347 

25 

79 

16 

42 

14 

149 

9 

99 

9 

258 

12 

130 

10 

44 

9 

35 

11 

1,024 

63 

664 

60 

933 

44 

482 

35 

260 

52 

114 

37 

378 

23 

73 

7 

234 

11 

121 

9 

37 

7 

16 

5 

560 

34 

522 

47 

664 

32 

352 

26 

197 

39 

91 

30 

37 

2 

69 

6 

30 

1 

9 

1 

3 

1 

7 

2 

1,637 

1,111 

2,106 

1,363 

502 

305 

1,667 

1,136 

2,234 

1,463 

542 

344 

DO  outliers  showed  a  substantial  propen- 
sity for  using  injectable  SA  penicillin  with 
no  oral  antibiotics;  DO  outliers  also  used 
(with  some  frequency)  injectable  lincomy- 
cin  with  no  oral  antibiotic.  The  variation  by 
provider  type  in  use  of  IM  antibiotics  for 
URI  was  markedly  reduced  by  Period  II. 

Quality  of  Care  by  Diagnosis  and 
Physician  Type 

This  section  presents  the  results  of  ap- 
plying the  quality-of-care  criteria  for  min- 
imal care  as  listed  in  Table  6.1  to  the 
episodes  of  these  6  conditions  for  the  vari- 
ous categories  of  physicians.  Table  6.7 
gives  the  percentages  of  episodes  that  met 
these  minimal  criteria  for  each  physician 
category  in  each  period.  Group  practices 
include  both  board-certified  and  noncer- 
tified  groups;  in  this  table  noncertified 
categories  for  MDs  and  DOs  include  out- 
liers. The  total  number  of  episodes  on 


which  these  percentages  are  based  can  be 
found  in  the  respective  Appendix  tables 
(Tables  6A-12B).U  Table  6.7  contains  2 
sets  of  significance  tests — one  for  the  dif- 
ferences between  group  practices  and  all 
other  physician  categories,  and  the  second 
for  the  differences  between  Periods  I  and 
II  for  each  physician  category. 

Strep  Throat.  The  criteria  for  adequate 
quality  of  care  of  strep  throat  (Table  6.1) 
included  "no  antibiotic  treatment"  only  if 
30  per  cent  or  more  of  the  provider  type's 
episodes  had  a  throat  culture  (group  prac- 
tices in  both  periods,  certified  MDs  in 


%  Applying  the  criteria  in  Table  6.1  to  the  data  in 
Appendix  B,  Tables  6A-12B  will  not  in  all  cases  pro- 
duce exactly  the  results  in  Table  6.7.  This  is  because 
the  percentages  in  Table  6.7  were  calculated  by  sum- 
ming the  number  of  episodes  treated  correcdy  and 
then  dividing  by  the  number  of  episodes,  not  by  figur- 
ing the  percentages  of  episodes  treated  by  the  various 
antibiotic  medications  and  then  summing.  The  latter 
approach  would  likely  give  different  results  for  those 
provider/disease  combinations  in  which  the  total 
number  of  episodes  is  small. 
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Table 

in   \A/r"iifri   ^  n       i  f  i /~»    1  \;r\oc   r\\  Tm 
111   WHICH  OpCL  111L    i  y  ptro  Ul  lllj 

ectable 

and  Oral  Antibiotics  were 

Used,  by  Type  of  Antibiotic, 

Diagnosis 

,  and  Period 

Strep  Throat 

Pharyngitis 

Otitis  Media  (0-4) 

It  lit 

i  ii 

I 

II 

Injeetable/Oral  Drug* 

(N  =  363)       (N  =  461) 

(N  =  2,133)     (N  =  2,067) 

(N  =  393) 

(N  =  150) 

None/none 

24  17 

17  23 

1  Q 

SA  penicillin/none 

9  5 

in  o 

4 

A  tii  nicil  in/  n/\n/i 
.  t  11  I  |  M  <  111111/  HOIlC 

1 

Tetracycline/none 

Lincornycin/none 

4 

o 
•i 

0 

tt 

LA  penicillin/none 

6  14 

2  8 

4 

5 

None/penicillin 

4  7 

8  17 

8 

6§ 

None/ampicillin 

5  5 

6  12 

15 

21§ 

None /tetracycline 

o  1 

o  n 

*s  y 

2 

4 

None/lincomycin 

1 
1 

1 

None/ery  thromycin 

1  1 

a  e 
4  5 

4 

4 

None/sulfa 

i 

1 
1 

None/all  other 

antibiotics 

4 

SA  penicillin/ 

penicillin 

6  6 

8  1 

1 

SA  penicillin/ 

ampicillin 

6  2 

7  1 

c 

O 

Q 
O 

^  A  ru?> ni^il  lin  / 
<J /»  LJtrlllC  111111/ 

tetracycline 

c 
O 

o 

2 

SA  penicillin/ 

lincomycin 

SA  penicillin/ 

erythromycin 

1 

1 

Tetracycline/ 

penicillin 

Tetracycline/ 

tetracycline 

1 
1 

Tetracycline/ 

lincomycin 

Lincomycin/ 

penicillin 

l 

1 

Lincomycin/ 

ampicillin 

4 

2 

3 

Lincomycin/ 

tetracycline 

A 

4 

2 

Lincomycin/ 

lincomycin 

1 

Lincomycin/ 

erythromycin 

LA  penicillin/ 

penicillin 

5 

1 

LA  penicillin/ 

ampicillin 

16 

4 

13  .,{ 

LA  penicillin/ 

tetracycline 

4 

LA  penicillin/ 

lincomycin 

2 

LA  penicillin/ 

sulfa 

1 

7 

3 

LA  penicillin/ 

erythromycin 

1 

Ampicillin/ penicillin 

1 

1 

Ampicillin/ampicillin 

Per  cent  of  episodes 

90  91 

88  93 

88 

95 

accounted  for  by 
these  categories 


SA:  short-acting;  LA:  long-acting. 

*  Antibiotic  before  the  slash  (/)  was  an  injection,  after  the  slash  a  filled  prescription, 
t  I:  Period  I;  II:  Period  II. 
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TABLE  6.6.  Continued. 


Otitis  Media  (5-7)t 


Bronchitis 


Influenza 


Acute  URI 


I 

II 

I 

II 

I 

II 

I 

II 

(N  =  156) 

(N  =  106) 

(N  =  1,637) 

(N  =  1,111) 

(N  =  502) 

(N  =  305) 

(N  =  2,106) 

(N  =  1,363) 

25 

22 

21 

35 

29 

47 

36 

51 

Q 

o 

O 
O 

1 
1 

O 

o 

z 

Q 

y 

o 
z 

2 

3 

6 

7 

2 

3 

9 

1 

1 

1 

1 

1 

8 

14 

7 

7 

4 

7 

5 

11 

10 

10 

5 

15 

7 

9 

8 

8 

2 

2 

9 

22 

8 

13 

6 

9 

1 

3 

1 

1 

1 

1 

5 

6 

2 

3 

2 

5 

3 

7 

1 

1 

1 

6 

2 

1 

1 

7 

5 

5 

2 

2 

3 

1 

1 

2 

1 

2 

2 

1 

1 

1 

13 


1 

~92 


1 

91 


95 


90 


91 


90 


89 


96 


t  Because  of  small  numbers,  episodes  of  otitis  media  occurring  in  people  older  than  7  years  are  not  considered  further  in  this 
monograph. 

§  An  additional  1  per  cent  was  the  combination  of  oral  ampicillin  and  penicillin  without  an  injectable  antibiotic. 
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Table  6.7.    Summary  of  the  Percentage  of  Episodes  with  Appropriate 
Use  of  Antibiotics,  by  Period,  Type  of  Provider,  and  Diagnosis 


Outlier  All  Outlier  All 

Total       Noncerti-       Noncerti-      Certified       Noncerti-      Noncerti-  Certified 
Period    Total       Groups     fied  MDs*     fied  MDs*  MDs        fied  DOs*      fied  DOs*  DOs 

Streptococcal  Sore  Throat 

36  88  4f  20}!  30}!  4}f  17 t  21f 

42  56§  43}§  53§  8lj§  16!"  29!"  6}# 

Pharyngitis 

41  80  191  42f  60f  16f  27f  24! 
56§         76             38f§             53f§             76§              37t§  48+§  20 1 

Otitis  Media,  Ages  0-4 

44  72  13$  f  37f  5411  Off  24 1  5}! 

55"  71 1  25}  30}#  68|  43}"  65}  §  60}" 

Otitis  Media,  Ages  5-7 

64  96|  31| t  68|#  78}H  10}!  43$ f  47}! 

78"        100|  70{H  58}#  80}  40}#  82}  §  50} 

Bronchitis** 

42  75  41f  65  79  <0.5f  23!  49}# 
81§         89"            81§              84§              87               40!  §             78§1t  87§ 

Influenza 

29  78}  19f  34f  47}#  5}!  15!  66} 

47§         60}  43!!  45}  61}  11}#  40§H  42} 

Acute  URI 

36  78  33!  44f  45!  2!  12!  56}# 

II  51§         81  55!§  52!!!  54!  32!§  37f§  77} 

*  Oudier  physicians  are  shown  as  separate  categories.  Because  they  were  all  noncertified,  they  also  are 
included  in  the  "all  noncertified"  categories. 

}  Based  on  fewer  than  50  episodes. 

11  Differences  from  group  practices  significant  at  p  <  0.05. 

#  Differences  from  group  practices  significant  at  p  <  0.01. 

!  Differences  from  group  practices  significant  at  p  <  0.001. 
11  Differences  between  Periods  I  and  II  significant  at  p  <  0.05. 
!!  Differences  between  Periods  I  and  II  significant  at  p  <  0.01. 

§  Differences  between  Periods  I  and  II  significant  at  p  <  0.001. 
**  Because  tetracycline  is  an  acceptable  therapy  for  bronchitis  only  in  persons  8  years  of  age  and  older,  all 
episodes  in  which  tetracycline  was  used  in  children  under  8  were  subtracted  before  the  summary  percentages 
were  calculated. 


Period  II).  Using  this  set  of  criteria  (Table 
6.7),  36  per  cent  of  all  strep  throat  episodes 
in  Period  I  and  42  per  cent  in  Period  II 
were  appropriately  treated.  In  Period  I, 
group  practices  treated  88  per  cent  of  strep 
throat  episodes  appropriately.  The  figure 
was  lower  for  every  other  physician  cate- 
gory, especially  MD  and  DO  outliers  (both  4 
per  cent);  all  differences  between  group 
practices  and  other  provider  types  were 


significant.**  In  Period  II,  group  practices 
experienced  a  significant  decline  in  qual- 
ity of  care,  to  56  per  cent  of  strep  throat 
episodes  being  treated  appropriately.  This 
drop  was  apparently  explained  by  an  in- 
crease in  the  proportion  of  cases  seen  by 
noncertified  groups  that  were  treated  with 


**  Hereafter,  the  term  "significant"  means  statisti- 
cally significant  at  p  <  0.05  or  lower. 
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IM  LA  penicillin  and  oral  ampicillin, 
which  was  judged  as  an  unnecessary  expo- 
sure to  ampicillin.  Quality  of  care  im- 
proved in  Period  II  for  all  solo  practice 
categories  except  certified  DOs.  All  im- 
provements except  that  of  certified  MDs 
were  statistically  significant. 

Pharyngitis.  In  Period  I,  41  per  cent  of 
these  episodes  were  correctly  treated;  by 
Period  II,  the  figure  was  56  per  cent — a 
significant  improvement.  In  Period  I,  80 
per  cent  of  all  group  practice  episodes 
were  managed  by  one  of  the  acceptable 
treatment  regimens.  Figures  for  all  other 
physician  types  were  significantly  lower, 
substantially  so  in  the  case  of  outlier  DOs 
(16  per  cent)  and  outlier  MDs  (19  per  cent). 
In  Period  II,  76  per  cent  of  pharyngitis 
episodes  were  treated  appropriately  for  all 
group  practices  and  certified  MDs;  figures 
were  lower  for  all  other  physician  types, 
but  less  so  than  in  Period  I  (although  dif- 
ferences were  still  significant).  The  Period 
II  figures  show  improvement  in  the  use  of 
appropriate  therapeutic  regimens  in 
pharyngitis  among  all  solo  provider 
categories  except  certified  DOs;  the  latter 
switched  from  reliance  on  IM  SA  penicil- 
lin to  oral  ampicillin  and  oral  tetracycline, 
neither  of  which  is  an  acceptable  therapy 
for  pharyngitis.  In  general,  improvement 
was  greatest  among  outliers. 

Otitis  Media.  Acceptable  therapies  for 
otitis  media  included  "none"  only  in  cases 
where  the  otitis  media  was  chronic  (serous 
otitis  media,  rather  than  infectious).  As- 
suming that  all  episodes  not  treated  with 
an  antibiotic  were  correctly  treated,  the 
proportion  of  otitis  media  episodes  in  chil- 
dren 4  and  younger  that  were  appropri- 
ately treated  was  44  per  cent  in  Period  I 
and  55  per  cent  in  Period  II.  The  percen- 
tage of  appropriately  treated  episodes  was 
highest  for  group  practices  (see  Table  6.7). 
The  level  of  care  provided  by  all  other  pro- 
vider categories  was  significantly  lower 
than  that  provided  by  group  practices. 
(Figures  in  Period  I  for  outlier  MDs,  out- 


lier DOs  and  certified  DOs  are  based  on 
fewer  than  50  episodes.)  By  Period  II,  the 
figures  for  appropriately  treated  episodes 
shifted  somewhat:  about  the  same  for 
group  practices  and  higher  for  all  provider 
types  except  noncertified  MDs  (for  whom 
the  Period  II  figure  was  lower).  (In  all 
cases,  the  percentages  were  based  on 
fewer  than  50  episodes  of  otitis  media 
being  treated.) 

For  5-  to  7-year-old  children,  acceptable 
therapeutic  possibilities  are  somewhat 
broader,  but  the  distinction  with  respect  to 
no  antibiotic  therapy  still  holds.  Roughly 
the  same  patterns  of  appropriate  use  of 
medications  by  provider  type  observed  for 
children  4  and  younger  were  observed  for 
those  5  to  7  years.  Specifically,  group  prac- 
tices treated  the  highest  proportion  of 
episodes  correctly  in  Period  I,  followed  by 
certified  MDs,  noncertified  MDs,  certified 
and  noncertified  DOs,  and  finally  outlier 
physicians  (see  Table  6.7).  Differences  be- 
tween group  practices  and  outlier  MDs 
and  all  DOs  were  significant.  In  general, 
all  provider  types  improved  their  use  of 
antibiotic  medications  for  this  condition 
between  Periods  I  and  II,  but  outlier  MDs 
and  DOs  still  treated  a  significantly  lower 
percentage  of  their  episodes  correctly  than 
did  group  practices. 

Bronchitis.  In  Period  I,  42  per  cent  of  all 
bronchitis  episodes  were  managed  by  one 
of  the  acceptable  treatment  regimens.  By 
Period  II,  the  figure  was  81  per  cent — 
again  a  significant  improvement.  In  Period 
I,  group  practices  used  appropriate  therapy 
in  75  per  cent  of  their  bronchitis  episodes 
(see  Table  6.7);  only  certified  MDs  treated 
a  higher  proportion  appropriately.  In  Pe- 
riod II,  89  per  cent  of  all  episodes  seen  by 
group  practices  were  treated  appropri- 
ately. The  figures  were  lower  for  all  other 
providers,  but  significantly  so  for  outlier 
DOs  and  all  noncertified  DOs.  The  im- 
provements in  antibiotic  use  for  all  pro- 
vider types  between  Periods  I  and  II  were 
significant  for  all  but  certified  MDs. 


79 


Influenza.  No  antibiotic  use  was  the  only 
acceptable  therapeutic  decision  defined 
for  influenza.  This  criterion  was  based  on 
the  known  viral  cause  of  influenza  and  the 
diagnostic  ranking  rule  that  was  applied  to 
these  data  (see  Methods,  above).  Episodes 
eventually  coded  as  influenza  were  very 
unlikely  to  have  had  a  recognized  bacterial 
component  (or  they  would  have  been  clas- 
sified in  one  of  the  bacterial  diagnoses); 
hence,  they  had  little  justification  for 
antibiotic  use. 

Of  the  influenza  episodes  in  Period  I 
(see  Table  6.7),  the  proportion  not  receiv- 
ing antibiotics  and  thus  treated  appropri- 
ately was  29  per  cent.  The  figure  for  Period 
II  was  47  per  cent;  this  represented  a  sig- 
nificant improvement.  The  proportion  cor- 
rectly treated  in  Period  I  ranged  from  78 
per  cent  (group  practices)  to  5  per  cent 
(outlier  DOs)  (based  on  fewer  than  50 
episodes).  Differences  between  groups 
and  all  solo  providers  except  certified  DOs 
were  significant. 

In  Period  II,  the  highest  figure  for 
episodes  receiving  no  antibiotics  was  61 
per  cent  for  certified  MDs  and  60  per  cent 
for  group  practices;  outlier  DOs  and  MDs 
and  all  noncertified  DOs  had  a  signifi- 
cantly lower  percentage  of  appropriately 
treated  influenza  episodes.  The  improve- 
ments in  quality  of  care  between  Periods  I 
and  II  were  significant  for  outlier  MDs  and 
all  noncertified  DOs. 

Acute  URI.  As  with  influenza,  "no  an- 
tibiotics" was  the  only  acceptable  antibi- 
otic therapy  for  this  condition,  because  of 
the  ranking  hierarchy  for  diagnoses  used  in 
this  study  and  the  viral  etiology  of  URI.  In 
Period  I,  the  appropriate  therapeutic 
choice  was  made  in  36  per  cent  of  all  URI 
episodes  and  in  Period  II,  51  per  cent.  In 
Period  I  group  practices  used  no  antibi- 
otics in  78  of  their  URI  episodes;  all  other 
provider  types  used  antibiotics  inappro- 
priately significantly  more  often  (see  Table 
6.7).  In  Period  II,  all  provider  types  had 
worse  records  than  group  practices  for 


acute  URI  episodes  (all  but  certified  DOs 
significantly  so).  Improvements  between 
Periods  I  and  II  were  significant  for  all 
outliers  and  all  noncertified  physicians. 

Summary  Comparisons 

If  our  hypothesis  is  correct  that  group 
practices  gave  better  care  overall,  they 
should  have  a  higher  percentage  of  cor- 
rectly treated  episodes  than  the  other 
physician  types  more  than  50  per  cent  of 
the  time  (because  by  chance  alone  they 
could  be  better  50  per  cent  of  the  time).  Of 
42  possible  comparisons  between  group 
practices  and  other  provider  types  in  Pe- 
riod I  f  f  (6  physician  types  times  7  disease 
categories),  we  observed  that  group  prac- 
tices were  better  than  solo  practitioners  in 
41  (98  per  cent),  significantly  so  in  39  cases. 
This  difference  between  expected  and  ob- 
served is  significant  (p  <  0.001).  In  Period 
II,  of  the  equivalent  42  pairs,  40  (95  per 
cent)  showed  better  quality  for  groups  than 
solo  providers  (p  <  0.001),  although  only 
21  such  complications  were  significant. 

Another  simple  way  to  summarize  these 
findings  is  to  look  at  the  "relative  advan- 
tage" of  group  practices  over  all  other 
physician  types  combined,  using  as  the 
metric  the  number  of  percentage  points 
that  group  practices  were  higher  than  solo 
practitioners,  averaged  across  all  diseases 
and  unweighted  for  numbers  of  episodes 
seen.  For  example,  taking  the  42  possible 
comparisons  in  Period  I,  group  practices 
provided  care  that  was,  on  average,  49  per- 
centage points  higher  than  the  solo  physi- 
cian categories.  Ry  Period  II,  their  relative 
advantage  had  fallen  to  24  percentage 
points.  This  phenomenon  reflects  a  de- 
sired reduction  in  the  variance  of  quality  of 
care  provided  while  maintaining  the  com- 
paratively high  standards  among  the  cer- 
tified group  practices. 


f  f  These  comparisons  are  based  on  the  percentages 
given  in  Table  6.7. 
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Similarly,  if  the  EMCRO  had  had  no  ef- 
fect, one  would  by  chance  alone  expect 
improvements  in  one-half  of  the  compari- 
sons between  Periods  I  and  II.  Of  the  49 
possible  comparisons  of  Period  I  with  Pe- 
riod II,  we  observed  at  least  some  im- 
provement in  use  of  antibiotics  in  40  (82 
per  cent)  (p  <  0.01).  Of  the  49  Period  I-II 
comparisons,  26  showed  that  care  was  sig- 
nificantly better  in  Period  IL 

Special  Analyses 

Tetracycline  in  Children  Less  Than  8 
Years  of  Age.  Use  of  tetracycline  in  either 
oral  or  IM  form  among  children  less  than  8 
years  of  age  is  an  unacceptable  therapy  be- 
cause of  the  high  risk  of  dental  complica- 
tions. Generally  speaking,  injectable  tet- 
racycline was  virtually  never  used  among 
children  less  than  8  years  of  age  for  these 
diagnoses.  By  contrast,  in  Period  I,  oral 
tetracycline  was  used  in  17  per  cent  of 
bronchitis  episodes  in  children  less  than  8 
years  of  age,  9  per  cent  of  pharyngitis 
episodes  and  6  per  cent  of  acute  URI 
episodes.  Differences  in  the  use  of  tet- 
racycline by  provider  type  within  this  age 
group  in  the  3  diagnoses  with  adequate 
sample  size  for  such  an  analysis  (pharyn- 
gitis, bronchitis,  acute  URI)  are  depicted  in 
Table  6.8.  In  Period  I,  the  use  of  tetracy- 
cline in  children  for  these  conditions  oc- 
curred more  frequently  among  DOs  than 
MDs.  The  highest  use  of  oral  tetracycline 
in  this  age  group  was  observed  for  MD  and 
DO  outliers  and  certified  DOs.  (Note  that 
the  noncertified  category  in  these  analyses, 
as  opposed  to  those  reported  in  Table  6.7, 
excludes  outliers.) 

Use  of  oral  tetracycline  dropped  for  all  3 
diagnoses  between  the  2  periods — from  9, 
17,  and  6  per  cent  of  all  episodes  of  pharyn- 
gitis, bronchitis  and  URI  to  5,  16  and  4  per 
cent,  respectively — but  significantly  so 
only  for  pharyngitis.  Use  of  oral  tetracy- 
cline by  group  practices  was  confined  gen- 
erally to  the  small  numbers  of  episodes 
seen  by  those  group  practices  for  which 


certification  status  was  unknown  (presum- 
ably noncertified)  or  by  facilities  with  no 
resident  physician.  Thus,  the  use  of  tet- 
racycline in  children  in  Period  II,  although 
slightly  lower  than  in  Period  I,  was  still 
unacceptably  high  among  at  least  some 
provider  types. 

Two  or  More  Classes  of  Antibiotics.  A 
clinical  appreciation  of  the  magnitude  of 
the  unnecessary  use  of  antibiotics  in  this 
population — which  reinforces  the  conclu- 
sions expressed  in  earlier  chapters  about 
the  EMCRO's  effect  on  quality  of  care — 
can  be  gained  from  examining  the  data  in 
Tables  6.9  and  6.10.  Table  6.9  gives  the 
percentages  of  episodes  of  the  3  most 
common  respiratory  conditions  that  were 
treated  by  more  than  1  class  of  antibiotics 
(e.g.  tetracycline  and  penicillin,  penicillin 
and  ampicillin,  penicillin  and  lincomycin). 
For  all  3  conditions,  combinations  of  dif- 
ferent antibiotic  classes  would  rarely  be  a 
recommended  therapeutic  strategy. 

In  Period  I,  about  one-quarter  of  all 
episodes  of  pharyngitis  and  bronchitis,  and 
about  one-fifth  of  all  episodes  of  URI,  were 
treated  with  2  or  more  classes  of  antibi- 
otics. Group  practices  and  certified  MDs 
rarely  used  more  than  1  class  of  antibiotics 
to  treat  these  common  conditions,  whereas 
outliers  rather  frequently  resorted  to  such 
combinations.  Even  about  one-fifth  of  pa- 
tients with  acute  URI  treated  by  outlier 
and  noncertified  DOs  received  more  than 
1  class  of  antibiotics.  Thus,  "polyphar- 
macy" with  respect  to  antibiotics  was  quite 
evident  in  Period  I  among  some  types  of 
physicians. 

By  Period  II,  the  use  of  multiple  classes 
of  antibiotics  for  these  respiratory  infec- 
tions had  decreased  to  almost  1  in  7  of 
pharyngitis  episodes  and  1  in  20  to  30  for 
bronchitis  and  URI  episodes.  Outlier  DOs, 
however,  continued  to  practice  a  high  de- 
gree of  polypharmacy  for  these  conditions. 

Lincomycin  in  Selected  Conditions. 
Table  6.10  presents  data  on  the  use  of  lin- 
comycin in  pharyngitis,  bronchitis,  and 
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Table  6.9.    Percentage  of  Episodes  Treated  with  2  or  More  Classes 
of  Antibiotics,  by  Diagnosis,  Period  and  Type  of  Provider 


Diagnosis 

and  Total 
Period  Total  Groups 


Outlier  All 
Noncerti-    Noncerti-  Certified 
tied  MDs    fied  MDs  MDs 


Outlier  All 
Noncerti-    Noncerti-  Certified 
fied  DOs     fied  DOs  DOs 


Pharyngitis 

Period  I  27  4  52  26  7  44  39  42 

Period  II  15  2  28  16  5  49  23  2* 

Bronchitis 

Period  I  26  6  17  11  3  55  37  35 

Period  II  5  3*  5  3  0  42  8  0 

Acute  URI 

Period  I  18  3  23  10  3  21  24  3* 

Period  II  3  1  2  2  1  22  6  0* 


*  Based  on  fewer  than  50  cases. 


acute  URI  episodes.  As  indicated  previ- 
ously, lincomycin  is  a  potent  antibiotic 
with  serious  side  effects  whose  use  is 
rarely  if  ever  indicated  for  outpatient 
treatment  of  these  common  conditions.  In 
Period  I,  16  per  cent  of  pharyngitis,  27  per 
cent  of  bronchitis,  and  7  per  cent  of  acute 
URI  episodes  were  treated  with  lincomy- 
cin. Use  was  disturbingly  high  among  out- 
lier DOs,  who  treated  about  one-half  of 
pharyngitis  episodes  and  two-thirds  of 
bronchitis  episodes  with  some  form  of 
lincomycin. 


By  Period  II,  total  use  of  lincomycin  had 
declined  remarkably,  to  6  per  cent  for 
pharyngitis,  4  per  cent  for  bronchitis  and  2 
per  cent  for  URI.  Use  among  outlier  DOs 
also  declined  sharply,  although  not  to 
levels  considered  acceptably  low. 

Quality  of  Care  by  Primary  Care  Spe- 
cialty. The  majority  of  episodes  of  these  6 
infectious  diseases  were  seen  by  solo 
physicians  in  general  practice  (who  should 
not  be  confused  with  board-certified 
physicians  in  family  practice).  As  a  result, 
detecting  differences  in  quality  of  care  by 


Table  6.10.    Percentage  of  Episodes  Treated  with  Either  Oral  or  Injectable 
Lincomycin  by  Diagnosis,  Period  and  Type  of  Provider 


Diagnosis 

Outlier 

All 

Outlier 

All 

and 

Total 

Noncerti- 

Noncerti- 

Certified 

Noncerti- 

Noncerti- 

Certified 

Period 

Total 

Groups 

fied  MDs 

fied  MDs 

MDs 

fied  DOs 

fied  DOs 

DOs 

Pharyngitis 

Period  I 

16 

1 

22 

10 

4 

59 

31 

8 

Period  II 

6 

3 

2 

2 

3 

32 

12 

4* 

Bronchitis 

Period  I 

27 

3 

3 

2 

4 

69 

43 

8 

Period  II 

4 

0 

2 

3 

1 

23 

0 

3 

Acute  URI 

Period  I 

7 

1 

8 

3 

1 

15 

10 

3* 

Period  II 

2 

1 

1 

1 

3 

8 

4 

0* 

*  Based  on  fewer  than  50  cases. 
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specialty  was  difficult.  Because  of  the  large 
number  of  episodes  of  pharyngitis,  how- 
ever, we  attempted  to  use  it  as  an  example 
of  how  quality  of  care  seemed  to  differ 
among  primary  care  physicians.  For  both 
MDs  and  DOs,  about  two-thirds  of  all 
pharyngitis  episodes  were  seen  by  general 
practitioners  (GPs).  The  numbers  of 
episodes  seen  by  other  types  of  specialists, 
however,  varied  widely  between  MDs  and 
DOs  (Table  6.11).  For  example,  MDs  who 
stated  that  they  were  obstetrician/ 
gynecologists  (OB/GYNs)  saw  almost  no 
episodes  of  pharyngitis  in  the  New  Mexico 
Medicaid  program,  whereas  DOs  in  the 
same  specialty  saw  a  relatively  large  per- 
centage of  such  episodes;  the  opposite  re- 
lationship was  observed  for  MD  and  DO 
pediatricians. 

In  Period  I,  MD  specialties  generally 
had  a  higher  percentage  of  episodes 
treated  appropriately  than  did  comparable 


DO  specialties.  By  Period  II,  the  trend  had 
largely  disappeared.  (See  Appendix  B,  Ta- 
bles 13A-13B,  for  a  detailed  description  of 
antibiotics  used  by  different  specialty 
types  for  episodes  of  pharyngitis.) 

Differences  among  specialists  within 
the  MD  and  DO  category  were  somewhat 
harder  to  decipher.  For  comparison  pur- 
poses, the  level  of  care  given  by  GPs  was 
used  as  the  basis  for  testing  differences 
among  specialists.  (Statistical  significance 
levels  using  GPs  as  the  base  are  shown  in 
Table  6.11.)  In  Period  I,  MD  physicians  in 
pediatrics,  internal  medicine  and  surgery 
all  gave  significantly  better  care  than  did 
MD  GPs.  (Pediatricians,  moreover,  gave 
significantly  better  care  than  internists  or 
general  surgeons.)  DO  physicians  in  inter- 
nal medicine  and  OB/GYN  gave  better 
care  than  DO  GPs.  (DOs  in  OB/GYN  also 
gave  significantly  better  care  than  DOs  in 
pediatrics  and  surgery.) 


Table  6.11.    Summary  of  Percentage  of  Pharyngitis  Episodes  Treated  Appropriately, 

by  Primary  Care  Specialty  and  Period 


Period  I 


Period  II 


Primary 

Care 
Specialty 


Number 
and  Per 
Cent  of 
Episodes* 


Percentage 
Treated 
Appropriately 


Number 
and  Per 
Cent  of 
Episodes* 


Percentage 
Treated 
Appropriately 


MD 

General  practice  733  (66) 

Internal  medicine  77  (7) 

Pediatrics  165  (15) 

Obstetrics/gynecology  9  (1) 

General  surgery  117  (11) 

DO 

General  practice  558  (68) 

Internal  medicine  6  (1) 

Pediatrics  15  (2) 

Obstetrics/gynecology  118  (14) 

General  surgery  112(14) 


36f  622  (64)  54f 

49}  111(11)  60 

68f"  151  (15)  59 

55  0  (0)  0 

48f§  83  (9)  68§ 

17f  553  (69)  441 

66"  5  (1)  78 

6t  19  (2)  62 

51"  185  (23)  32§ 

23f  32  (4)  60} 


*  The  percentage  of  all  pharyngitis  episodes  in  Periods  I  and  II  seen  by  MDs  (1105;  975)  or  DOs  (819;  800) 
in  these  five  primary  care  specialties  is  given  in  parentheses. 

t  Differences  between  like  categories  of  MD  and  DO  specialists  significant  at  p  <  0.001,  one-tailed  test; 
all  other  differences  not  significant. 

}  Differences  between  general  practitioners  (GPs)  and  specialists  within  MD  and  DO  categories  signifi- 
cant at  p  <  0.05. 

§  Differences  between  GPs  and  specialists  within  MD  and  DO  categories  significant  at  p  <  0.01. 
1  Differences  between  GPs  and  specialists  within  MD  and  DO  categories  significant  at  p  <  0.001. 
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By  Period  II,  most  of  these  distinctions 
had  disappeared.  This  convergence  of 
levels  of  quality  of  care  is  reflected  in  the 
observation  that  between  Periods  I  and  II 
most  primary  care  specialty  types  im- 
proved the  care  they  gave  for  patients  with 
pharyngitis.  For  MDs,  every  category  ex- 
cept pediatricians  improved  (significantly 
so  for  GPs  and  surgeons).  The  explanation 
for  the  drop  in  the  percentage  of  episodes 
of  pharyngitis  appropriately  treated  by 
pediatricians  appeared  to  be  a  shift  away 
from  the  use  of  oral  erythromycin  in  favor 
of  oral  ampicillin. 

For  DOs,  all  providers  except  OB/GYNs 
improved  their  performance  (significantly 
so  for  all  but  internal  medicine).  The  de- 
cline in  the  quality  of  care  for  OB/GYN 
may  be  explained  by  the  disappearance  of 
the  use  of  the  combination  of  IM  and  oral 
penicillin  (which  was  considered  an  ac- 
ceptable therapy  for  pharyngitis).  In  addi- 
tion, OB/GYNs  seemed  to  shift  to  using  IM 
LA  penicillin  with  oral  lincomycin,  which 
is  unacceptable  on  the  grounds  that  2  an- 
tibiotic types  are  being  used  and  that  lin- 
comycin should  not  be  used  for  this  condi- 
tion at  all. 

These  findings  on  primary  care  specialty 
are  too  mixed  and  limited  to  lend  them- 
selves to  definitive  interpretation  about 
the  relationship  between  quality  and  spe- 
cialty per  se.  Two  tentative  conclusions 
might  be  put  forth,  however.  First,  this 
analysis  suggests  that  the  MD/DO  distinc- 
tion persists  for  the  class  of  physicians 
self-described  as  GPs  but  less  so  (if  at  all) 
for  those  self-described  in  one  or  another 
specialty.  Second,  the  range  of  percentages 
of  episodes  treated  appropriately  both  rose 
and  became  smaller  by  Period  II,  reaffirm- 
ing the  general  view  that  the  variance  in 
care  as  a  function  of  physician  type  was 
reduced  for  this  Medicaid  population. 

Quality  of  Care  by  Use  of  Laboratory  Tests 

We  used  disease-specific  quality-of-care 
criteria  for  laboratory  tests  that  were  much 


less  specific  than  those  for  antibiotics.  This 
decision  was  taken  because  there  is  no 
universal  agreement  as  to  the  level  of  qual- 
ity of  care  represented  by  even  as  basic  a 
step  as  throat  cultures  in  streptococcal  in- 
fections (see  Chapter  IV),  although  most 
observers  indicate  that  some  use  of  certain 
laboratory  tests  for  these  conditions  is  cer- 
tainly warranted.  We  took  the  view  simply 
that  a  throat  or  strep  culture,  a  white  blood 
cell  count  (WBC)  or  a  complete  blood  cell 
count  (CBC)  would  be  a  "relevant"  test  in 
upper  respiratory  tract  infections  such  as  a 
strep  throat  or  pharyngitis.  Similarly,  chest 
roentgenography  or  a  WBC/CBC  in  bron- 
chitis would  be  "relevant"  diagnostic  pro- 
cedures. Because  these  tests  have  virtually 
no  risk  of  side  effects  (for  persons  with 
these  common  conditions)  and  can  be  ex- 
pected to  provide  useful  information,  our 
basic  premise  was  that  higher  quality  of 
care  was  represented  by  the  episodes  with 
"relevant"  diagnostic  procedures. 

The  assumptions  about  the  use  of  labora- 
tory tests  and  their  relationship  to  quality 
of  care  are  roughly  the  same  for  pharyngitis 
and  for  strep  throat.  Throat  and  strep  cul- 
tures are  recommended  by  many  experts  as 
essential  in  determining  whether  the 
cause  of  the  sore  throat  is  bacterial  or  viral 
(as  noted  in  Chapter  IV).  A  WBC  can  be 
useful  because  a  high  count  may  indicate  a 
bacterial  etiology  and  because  the  results 
can  be  obtained  immediately  (in  contrast  to 
the  day  or  longer  needed  to  obtain  results 
from  a  throat  culture). 

Table  6.12  illustrates  the  use  of  these 
selected  tests  for  each  disease  in  each  time 
period.  In  Period  I,  by  far  the  greatest  use 
observed  for  throat  cultures  was  for  strep 
throat,  but  still  only  21  per  cent  of  all  sore 
throats  labeled  as  strep  throat  were  cul- 
tured. Use  of  laboratory  tests  in  strep  throat 
varied  markedly  by  provider  type.  For 
example,  81  per  cent  of  all  strep  throat 
episodes  seen  by  group  practices  received 
a  throat  culture  (compared  with  5  per  cent 
for  all  MDs  and  none  for  all  DOs). 
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In  Period  II,  use  of  cultures  in  strep 
throat  declined  significantly  among 
episodes  seen  by  group  practices  (to  44  per 
cent)  and  increased  significantly  among 
those  seen  by  MDs.  This  finding  is  ex- 
plained by  the  low  level  of  use  of  throat 
cultures  by  noncertified  groups,  accom- 
panied by  the  substantial  rise  in  the 
number  of  episodes  diagnosed  as  strep 
throat  by  these  providers.  Thus,  the  drop  in 
use  of  throat  cultures  is  not  characteristic  of 
the  practice  of  the  large  certified  group 
practices.  Use  of  WBCs  in  strep  throat  was 
low  in  both  periods  but  their  use  rose 
slightly  for  group  practices  and  MDs  be- 
tween the  2  time  periods. 

In  Period  I,  overall  use  of  cultures  in 
pharyngitis  was  only  4  per  cent,  and  ranged 
from  33  per  cent  for  group  practices  (43  per 
cent  for  the  certified  group  practices)  to  3 
per  cent  or  less  for  any  MD  or  DO  solo 
practice  category  (and  none  among  DO 
outliers).  Use  of  WBCs  was  uniformly  low 
(3  per  cent  or  less  among  all  physician 
categories). 

The  overall  rise  in  throat  cultures  in 
pharyngitis  episodes  between  Periods  I 
and  II  (from  4  to  11  per  cent)  was  brought 
about  largely  by  the  increase  in  their  use 
among  solo-practice  physicians  (MDs 
more  than  DOs,  and  all  certified  physi- 
cians more  than  noncertified).  In  general, 
little  change  in  the  use  of  WBCs  was  ob- 
served between  the  2  time  periods  except 
for  a  significant  increase  in  their  use  among 
group  practices. 

Use  of  laboratory  tests  for  otitis  media 
was  quite  low  in  both  periods,  except  for 
throat  cultures  (which  were  done  almost 
exclusively  by  group  practices).  MD  and 
DO  outliers  used  no  laboratory  tests  at  all 
among  the  few  cases  of  otitis  media  that 
they  treated. 

Throat  cultures  and  WBCs  might  be  con- 
sidered useful  diagnostic  steps  in  bron- 
chitis for  reasons  similar  to  those  for  other 
respiratory  infections;  in  addition,  chest 
roentgenograms  can  be  an  important  diag- 
nostic tool  in  helping  to  distinguish  pa- 


tients with  pneumonia  from  those  with 
bronchitis.  Cultures  and  WBCs  were  used 
very  infrequently  by  any  physician  type  in 
either  period.  In  Period  I,  group  practices 
used  chest  roentgenography  in  19  per  cent 
of  their  bronchitis  episodes.  Apart  from 
MD  outliers,  who  used  chest  roentgenog- 
raphy in  8  per  cent  and  WBCs  in  7  per  cent 
of  bronchitis  episodes,  use  of  laboratory 
tests  in  patients  with  bronchitis  by  any 
other  provider  type  was  very  low  in  Period 
I.  In  Period  II,  the  highest  use  of  chest 
roentgenography  was  again  among  group 
practices  (10  per  cent),  although  this  was 
lower  than  in  Period  I.  Use  of  chest 
roentgenography  rose  significantly  for  out- 
lier and  noncertified  DOs,  but  was  still 
quite  low  (about  4  per  cent  of  all  episodes). 

No  particular  laboratory  tests  would  be 
considered  mandatory  in  episodes  of  in- 
fluenza or  acute  URI.  Some  might  be  con- 
sidered acceptable  in  cases  where  other 
potential  diagnoses  might  need  to  be 
eliminated,  chiefly  throat  cultures  and 
WBCs  to  rule  out  bacterial  disease.  Use  of 
laboratory  tests  in  influenza  was  extremely 
low  in  both  periods  but  higher  in  Period  II 
than  I.  Only  group  practices  used  throat 
cultures  in  Period  I;  WBCs  were  used 
chiefly  by  MDs.  In  Period  II,  use  of  throat 
cultures  was  still  low,  but  group  practices 
and  all  MDs  increased  their  use  of  WBCs 
significantly.  Typically,  the  highest  per- 
centage of  acute  URI  episodes  with  either 
throat  cultures  or  WBCs  in  both  time  pe- 
riods was  among  group  practices.  Use  of 
these  laboratory  tests  increased  between 
the  2  periods,  chiefly  among  MDs,  but 
again  overall  use  of  both  tests  in  both  pe- 
riods was  very  low. 

In  summary,  group  practices  uniformly 
used  common  laboratory  tests  more  often, 
across  all  conditions,  than  any  other  physi- 
cian type.  Generally,  use  of  tests  rose  be- 
tween the  2  periods,  but  in  most  cases  only 
to  levels  that  still  seem  rather  low,  espe- 
cially for  patients  with  a  sore  throat  who 
were  diagnosed  as  having  either  strep 
throat  or  pharyngitis.  Unlike  the  extremely 
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high  rate  of  overuse  of  antibiotic  medi- 
cations that  was  found  in  this  study, 
especially  in  Period  I,  no  corresponding 
overuse  of  common  laboratory  tests  was 
discovered. 

Quality  of  Care  by  Revisit  Rates 

One  major  tenet  of  primary  care  is  good 
follow-up  and  continuity  of  care.93  For 
these  common  conditions,  however,  reso- 
lution of  die  illness  should  typically  occur 
widiin  1  to  2  weeks,  and  follow-up  visits 
are  usually  not  needed.  Revisits  in 
episodes  of  otitis  media  widiin  6  weeks, 
however,  are  typically  recommended,  to 
make  sure  that  the  infection  has  been  com- 
pletely eliminated  and  that,  even  though 
the  patient  is  asymptomatic,  no  fluid  re- 
mains in  the  ear.  Thus,  we  ascertained 
whedier  revisit  rates  for  otitis  media  dif- 
fered by  type  of  provider.  Revisits  were 
counted  any  time  between  7  days  and  6 
weeks  following  the  initial  visit  in  the  otitis 
media  episode  in  2  ways:  1)  if  they  were 
made  to  any  physician  for  the  diagnosis  of 
otitis  media  explicitly,  or  2)  if  they  were 
made  to  the  doctor  who  treated  the  otitis 
media  initially  for  any  reason.  This  latter 
rule  was  based  on  the  assumption  that  if  a 
child  returned  to  the  same  physician  for 
almost  any  reason,  the  physician  would 
still  check  the  ears  for  the  presence  of  fluid. 

Using  the  6-weeks  specification  (Table 
6.13),  504  otitis  media  episodes  were  seen 
in  Period  I,  and  144  (29  per  cent)  received 
at  least  1  revisit  7  days  to  6  weeks  after  the 
episode  began.  This  rate  varied  slightly  by 
provider  (although  some  figures  are  based 
on  small  numbers  of  episodes),  but  the 
highest  revisit  rates  were  for  group  prac- 
tices (37  per  cent),  noncertified  DOs  (35 
per  cent)  and  certified  MDs  (27  per  cent). 
Outliers  and  noncertified  MDs  had  rates 
significantly  lower  than  group  practices. 
Revisit  rates  seemed  to  drop  slightly  by 
Period  II,  mostly  among  physician 
categories  with  higher  rates  in  Period  I. 
The  most  notable  exception  was  for  non- 


certified  MDs,  whose  revisit  rate  rose  sig- 
nificantly between  the  2  time  periods. 

Summary:  Quality-of-Care  Evaluation 

The  principal  hypotheses  in  these 
analyses  were  as  follows:  1)  quality  scores 
would  be  higher  in  Period  II  than  I;  2)  all 
solo  physicians  would  have  lower  levels  of 
quality  tiian  group  practices;  3)  outliers  (as 
defined  by  use  of  all  injections)  would 
have  the  poorest  records  in  use  of  IM  and 
oral  antibiotics  in  these  specific  respiratory 
diseases;  and  4)  physicians  who  were 
worst  in  Period  I  would  improve  the  most 
(i.e.,  the  variance  in  care  would  de- 
crease). In  general,  these  hypotiieses  were 
confirmed. 

The  first  major  finding  of  this  study, 
however,  related  to  the  general  levels  of 
care  as  assessed  by  antibiotic  use  across  all 
diagnoses.  The  percentages  of  episodes 
treated  appropriately  ranged  widely,  de- 
pending on  the  disease.  In  Period  I,  for 
example,  influenza  episodes  (taking  all 
provider  types  together)  were  treated  ap- 
propriately 29  per  cent  of  the  time, 
whereas  episodes  of  otitis  media  in  5-  to 
7-year-olds  were  treated  appropriately  64 
per  cent  of  die  time.  By  Period  II,  the  range 
had  shifted  upward.  Strep  throat,  the  low- 
est, was  treated  correctly  42  per  cent  of 
the  time,  and  bronchitis  was  highest  at 
81  per  cent.  Improvements  between  the  2 
periods  were  significant  for  all  conditions 
but  strep  throat.  These  findings  were  all 
consistent  with  the  first  hypothesis. 

One  way  of  summarizing  these  findings 
is  to  look  at  the  improvement  achieved  (as  a 
percentage  of  the  improvement  possible). 
This  is  basically  the  following  ratio:  per- 
centage correctly  treated  in  Period  II  (PC 
II)  minus  the  percentage  correctly  treated 
in  Period  I  (PC  I),  all  divided  by  the  per- 
centage of  improvement  that  could  have 
been  achieved  (100  per  cent  —  Period  I  per 
cent),  or  (PC  II  -  PC  I)/(100  -  PC  I). 
Looked  at  in  this  fashion,  across  all 
episodes,  bronchitis  improved  die  most,  67 
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Table  6.13.    Number  and  Per  Cent  of  Episodes  of  Otitis  Media  in  which 
a  Revisit  Occurred  within  6  Weeks,  by  Type  of  Provider  and  Period 


Period  I  Period  II 

Episodes  with  Episodes  with 

Revisits  Revisits 

Type  of  Number  of    Number  of 


Provider  Episodes!       Number   Per  Cent       Episodes       Number   Per  Cent 


Total* 

Group  practices 

Outlier  noncertified  MDs| 

All  noncertified  MDs 

Certified  MDs 

Outlier  noncertified  DOs{ 

All  noncertified  DOs 

Certified  DOs 


504  144  29 

101  37  37 

37  7  19§ 
120  22  18" 

71  19  27 

32  9  28 

165  58  35 

38  7  18§ 


267  68  25 

50  15  30 

17  5  29 

52  17  33# 

48  11  23 

14  4  29 

101  23  23# 

10  2  20 


*  Total  includes  physicians  for  whom  certification  status  is  unknown. 

f  Episodes  are  for  6-week  time  frames  and  for  patients  of  all  ages.  For  definition  of  revisit,  see  text. 
$  Outliers  are  listed  separately;  because  all  outliers  were  noncertified  they  are  also  included  in  their 
respective  noncertified  categories. 

§  Differences  from  group  practices  significant  at  p  <  0.05. 
1  Differences  from  group  practices  significant  at  p  <  0.01. 

#  Differences  between  Periods  I  and  II  significant  at  p  <  0.05. 


per  cent  of  achievable;  otitis  media  in  5-  to 
7-year-olds,  39  per  cent;  pharyngitis  and 
influenza,  both  25  per  cent;  acute  URI,  23 
per  cent;  otitis  media  in  children  4  and 
younger,  20  per  cent;  and  strep  throat,  9  per 
cent. 

Nevertheless,  only  about  half  of  all 
episodes  of  these  common  diseases  were 
being  handled  appropriately,  even  after 
the  EMCRO  had  had  its  major  effect  on  the 
use  of  antibiotic  injections,  and  only  1  con- 
dition (bronchitis)  showed  anything  like 
what  might  have  been  hoped  for  in 
the  form  of  achievable  improvement. 
Moreover,  these  findings  were  derived 
from  an  evaluation  based  on  criteria  for  a 
minimal  level  of  quality  of  care:  episodes 
were  classified  hierarchically  by  diagnosis, 
the  rules  for  assigning  services  gave  physi- 
cians the  benefit  of  the  doubt,  and  the  op- 
tion of  "no  antibiotic  therapy"  was  allowed 
in  certain  circumstances  as  an  acceptable 
therapy  in  conditions  normally  considered 
to  have  a  bacterial  etiology. 

Evidently,  many  episodes  of  these 
common  respiratory  conditions  were  re- 


ceiving the  wrong  antibiotic  or  too  many 
antibiotics,  and  many  in  Period  II  were 
still  being  treated  unnecessarily  with  anti- 
biotics; arguably,  although  we  have  no 
direct  evidence,  some  may  have  not  re- 
ceived antibiotics  when  they  were  indi- 
cated. These  findings  can  be  interpreted  as 
a  negative  reflection  of  the  level  of  basic 
care  still  encountered  in  this  Medicaid 
population. 

The  second  finding  related  to  differ- 
ences among  provider  types.  Group  prac- 
tices had  been  hypothesized  as  giving  better 
care  than  any  other  provider  type,  be- 
cause the  findings  from  the  earlier  (2-year) 
evaluation7  showing  this  to  be  the  case  had 
been  replicated  in  the  results  reported  in 
the  early  chapters  of  this  report.  Hence,  all 
tests  of  significance  of  differences  between 
provider  types  used  group  practices  as  the 
basis  of  comparison,  and  assumed  that 
physicians  in  solo  practice  would  provide 
lower  quality  of  care.  Because  the  total  of 
group  practices  included  noncertified 
practices  as  well  as  the  large  multispecialty 
practices  and  clinics,  the  differences  with 
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solo  providers  are  lower  than  would  have 
been  die  case  if  only  the  latter  were  used  as 
the  comparison  group.  Moreover,  the 
numbers  of  episodes  seen  by  group  prac- 
tices is  lower  than  for  most  other  provider 
types;  for  example,  groups  saw  only  about 
10  per  cent  of  all  influenza  episodes  and 
about  5  per  cent  of  all  bronchitis  episodes. 
This  means  that  the  "average"  level  of  care 
given  to  this  population  was  much  lower 
than  that  reflected  in  the  figures  for  group 
practices,  even  though  the  latter  have  been 
extensively  cited  in  this  chapter.  In  any 
event,  group  practices  gave  care  (as  meas- 
ured by  use  of  antibiotic  medications)  typi- 
cally equal  to  or  better  than  any  type  of 
physician  in  solo  practice  in  both  time  pe- 
riods. Thus,  the  second  hypothesis  was 
generally  confirmed. 

The  third  hypothesis  was  that  outlier 
physicians  would  give  the  poorest  levels  of 
care  on  these  broader  medications  criteria, 
and  this  was  borne  out.  MD  and  DO  out- 
liers gave  consistently  and  markedly  poor 
levels  of  care  (especially  compared  with 
group  practices)  for  all  diseases  in  Period  I; 
in  Period  II,  MD  outliers  still  gave  signifi- 
cantly lower  levels  of  care  than  group  prac- 
tices for  half  the  conditions  and  outlier 
DOs  for  all  but  one.  For  example,  even 
after  the  peer  review  intervention  regard- 
ing use  of  injections,  60  per  cent  of  bron- 
chitis episodes  seen  by  DO  outliers  were 
treated  inappropriately,  as  were  63  per 
cent  of  their  pharyngitis  episodes,  84  per 
cent  of  their  strep  throat  episodes  and  89 
per  cent  of  their  influenza  episodes.  Fig- 
ures for  MD  outliers  included  57  per  cent 
of  strep  throat  and  influenza  episodes  and 
62  per  cent  of  pharyngitis  still  treated  in- 
appropriately in  Period  II,  but  only  19  per 
cent  of  episodes  of  bronchitis.  Because 
MD  outliers  and  (to  a  lesser  degree)  DO 
outliers  decreased  their  use  of  injectable 
antibiotics  substantially  (see,  e.g.,  Table 
5.10),  we  concluded  that  this  persistent  de- 
ficiency in  quality  was  attributable  to  the 
poor  choice  of  oral  medications,  some  un- 


acceptable "polypharmacy,"  and  continu- 
ing overtreatment.  These  figures  are  all  the 
more  startling  because  DO  and  MD  out- 
liers saw  a  substantial  fraction  of  all  the 
episodes  of  these  diseases.  For  example, 
between  them,  MD  and  DO  outliers  saw 
about  25  per  cent  of  all  pharyngitis 
episodes,  30  per  cent  of  strep  throat,  be- 
tween 30  and  15  per  cent  of  bronchitis  (Pe- 
riods I  and  II),  and  between  20  and  30  per 
cent  of  influenza  (Periods  I  and  II). 

Findings  as  to  other  physician  charac- 
teristics were  mixed.  Especially  in  Period 
I,  DOs  gave  consistently  poorer  care  than 
MDs.  Comparisons  of  like  groups  (e.g., 
noncertified  MDs  and  DOs;  certified  MDs 
and  DOs)  showed  that  for  most  diseases  in 
both  periods,  MDs  had  a  higher  proportion 
of  adequately  treated  episodes.  In  addi- 
tion, when  the  MD/DO  comparison  was 
done  by  specialty  (for  pharyngitis),  MD 
GPs  gave  significantly  better  care  than  DO 
GPs.  (Small  numbers  of  cases  precluded 
rigorous  comparisons  in  other  specialties.) 

Within  the  MD  and  DO  categories, 
board-certified  physicians  sometimes,  but 
not  always,  gave  better  care  than  noncer- 
tified physicians  across  all  diseases.  For 
example,  in  Period  II,  noncertified  and  cer- 
tified MDs  gave  nearly  the  same  level  of 
care  for  bronchitis,  influenza  and  URI;  the 
same  was  true  for  DOs  for  bronchitis,  in- 
fluenza and  otitis  media  in  children  4  years 
old  and  younger.  (Other  differences  for 
DOs  were  often  based  on  extremely  small 
numbers  of  cases  treated  by  certified  DOs.) 
Overall  trends  supported  the  hypothesis  of 
better  quality  of  care  among  the  board- 
certified,  especially  for  MDs. 

The  greatest  improvements  in  the  ap- 
propriateness of  use  of  medications  for 
these  diseases  were  observed  for  DOs; 
these  improvements  were  significant  for 
about  half  the  diseases  studied  (especially 
for  noncertified  DOs).  Among  MDs,  the 
improvements  in  quality  of  care  between 
the  2  periods  were  observed  for  nearly 
every  condition,  but  were  significant  most 
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often  for  outliers.  These  results  tend  to 
support  the  hypothesis  that  the  most  pos- 
itive changes  would  be  observed  among 
the  poorest  performers  (notwithstanding 
the  finding  that  the  care  given  by  such 
physicians  may  still  be  at  unacceptably  low 
levels).  This  finding  also  means  that  the 
variance  among  providers  was  substan- 
tially reduced,  which  can  be  viewed  as  a 
definite  improvement  in  the  overall  care  to 
this  population,  whose  access  to  the  best 
physician  is  less  than  desirable. 

Use  of  laboratory  tests  was  extremely 
low  in  these  conditions.  For  example,  only 
about  one-fifth  of  all  strep  throat  episodes 
in  Periods  I  and  II  received  eitiier  a  throat 
culture  or  a  white  blood  cell  count,  yet  the 
literature  suggests  that  physicians  can  cor- 
rectly make  this  diagnosis  without  such  a 
test  only  about  one-half  of  the  time.  Slight 
increases  in  the  use  of  at  least  1  relevant 
laboratory  test  were  observed  for  all  dis- 
eases over  time  except  for  strep  throat.  The 
patterns  of  use  of  laboratory  tests  by  pro- 
vider type  were  analogous  to  those  for  an- 
tibiotic use — namely,  higher  use  of  rele- 
vant tests  by  group  practices  and  virtually 
no  use  by  outliers.  When  quality  of  care 
was  evaluated  in  terms  of  revisit  rates  in 
otitis  media,  less  than  two-fifths  of  all 
episodes  had  a  required  follow-up  visit. 

Discussion 
Episode-of-Illness  Methods 

Empirically,  establishing  episodes  of 
illness  from  a  claims  data  base  was  some- 
what complicated,  because  of  the  need  for 
many  decision  rules  as  to  the  cohort  to  use, 
how  to  assign  services  properly  to  episodes 
by  diagnosis,  and  so  forth.  Such  efforts 
were  made  simpler  by  eliminating 
Medicaid  aid  categories  of  disabled  or  el- 
derly populations  and  by  selecting  com- 
mon, usually  self-limited  diseases.  The 
methodologic  work  described  in  this  re- 
port suggested  that  services  had  been  as- 
signed satisfactorily  to  episodes,  and  we 
judged  that  reasonable  inferences  could  be 


drawn  about  the  quality  of  care  based  on 
entire  episodes  of  illness.  From  the  point  of 
view  of  developing  a  practical  quality-of- 
care  methodology,  this  is  an  important 
finding,  because  of  the  likely  future  need 
to  rely  more  and  more  on  such  data  sources. 

Certain  points  as  to  the  overall  validity  of 
this  approach  should  be  emphasized,  how- 
ever. First,  because  many  algorithms  for 
creating  episodes  of  care  were  based  on 
diagnoses,  perhaps  the  most  crucial  prob- 
lem is  the  degree  of  conf  idence  that  can  be 
placed  in  diagnoses  recorded  on  Medicaid 
claim  forms,  especially  because,  as  some 
work  suggests,15,70  information  from  health 
records  is  not  always  reliable.  Because  re- 
liability in  effect  puts  a  ceiling  on  the  level 
of  achievable  validity,  this  question  was 
explored  in  several  indirect  ways. 

In  the  preliminary  analyses,  an  effort 
was  made  to  see  if  physicians  shifted  diag- 
nostic categories  between  Periods  I  and  II 
to  justify  antibiotic  injections  for  which 
payment  would  otherwise  have  been  disal- 
lowed, as  it  might  have  been  monetarily 
desirable  to  do  so.  No  evidence  of  any  sub- 
stantial shifts  in  diagnosis  recording  was 
detected.  Furthermore,  it  will  be  recalled 
that  Medicaid  claims  for  all  services  except 
prescription  drugs  were  reviewed  against 
guidelines  that  themselves  were 
diagnosis-specific.  Hence,  illegible,  odd, 
or  implausible  diagnoses  were  screened 
by  clerical  personnel  and/or  peer  review 
physicians  in  the  EMCRO  and  question- 
able diagnostic  patterns  were  referred  to 
the  physicians  giving  the  care  for  correc- 
tion prior  to  final  processing.  In  addition, 
the  data  set  on  which  these  analyses  were 
based  was  unusually  complete;  the 
Medicaid  fiscal  intermediary  at  the  time 
(The  Dikewood  Corporation)  had  de- 
veloped sophisticated  systems  for  check- 
ing and  cleaning  records,  resulting  in  data 
of  high  quality.  Further,  in  deriving  the 
hierarchy  of  infectious  disease  diagnoses,  a 
review  of  combinations  of  diagnoses  ap- 
pearing on  single  records  (e.g.,  claims  for 
office  visits)  did  not  yield  worrisome  com- 
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binations,  suggesting  that  diagnoses  were 
reasonably  accurate. 

A  second  problem  arises  from  the  ques- 
tion of  multiple  physicians  giving  care  for  a 
single  episode.  These  respiratory  illness 
episodes  had,  on  average,  less  than  one- 
fifth  of  an  office  visit  in  addition  to  the  visit 
initiating  the  episode.  This  phenomenon 
meant  that  the  most  common  pattern  of 
care  was  a  single  office  visit  to  1  physician, 
with  little  or  no  input  from  other  physi- 
cians. This  in  turn  mitigated  problems  of 
analyzing  the  quality  of  care  by  physician 
characteristics  in  episodes  treated  by  more 
than  1  provider. 

A  third  issue  arises  regarding  the 
simplicity  of  the  quality-of-care  criteria 
used.  Quality-of-care  assessment  using  in- 
surance claim  form  data  cannot  be  done 
with  contingent  criteria  that  might  permit 
assessment  of  therapy  in  the  context  of,  for 
example,  diagnostic  test  results.  Our 
criteria,  however,  were  based  on  sound, 
up-to-date  medical  practice,  were  simple 
to  understand,  and  were  easy  to  apply. 
Moreover,  they  were  written  so  as  to  give 
the  benefit  of  the  doubt  to  physicians  with 
respect  to  use  of  antibiotic  medications, 
meaning  that  our  findings  about  deficient 
practices  are  conservative.  In  addition,  dif- 
ferences in  quality  of  care  by  physician 
type  were  consistent  across  the  6  diag- 
noses; the  results  based  on  medications 
criteria  were  also  consistent  with  findings 
about  use  of  relevant  laboratory  tests.  Con- 
sequently, even  given  the  rather  serious 
constraints  on  the  type  of  criteria  that  might 
be  articulated  for  a  quality-of-care  study 
based  on  insurance  claims  data,  the  valid- 
ity and  applicability  of  these  criteria  ap- 
pear to  be  within  acceptable  limits. 

Fourth,  the  validity  of  generalizing  find- 
ings from  this  study  to  the  broader  contexts 
of  PSROs,  the  Medicaid  population  in 
general,  or  the  U.S.  population  as  a  whole 
must  be  considered.  Extrapolating  from 
New  Mexico  to  the  national  PSRO  program 
is  not  without  hazard,  because  much  of  the 
New  Mexico  Medicaid  population,  which 


is  overwhelmingly  white,  is  found  in  rural 
counties  and  because  the  environment  in 
which  the  EMCRO  operated  was  excep- 
tionally conducive  to  successful  peer  re- 
view activities,  especially  those  aimed  at 
improving  quality  of  care.  Nevertheless,  be- 
cause the  EMCRO's  activities  were  gener- 
ously funded,  because  the  analyses  were 
based  on  a  cohort  that  did  not  change  (ex- 
cept for  aging),  and  because  the  longitudi- 
nal analyses  are  reasonably  close  to  a  true 
before/after  study  design,  we  believe  that 
our  findings  will  provide  a  valid  bench- 
mark by  which  to  judge  the  likely  upper 
level  of  accomplishment  of  any  PSRO  am- 
bulatory care  review  effort. 

Finally,  episode  methods  probably  can- 
not be  widely  extended  at  the  moment, 
given  the  underdeveloped  state  of  most 
data  bases  available  to  PSROs.  Taking  ac- 
count of  underlying  disease  may  be  dif- 
ficult when  the  chief  source  of  data  is  an 
insurance  claim  form;  for  example,  space 
for  recording  relevant  additional  diagnoses 
may  be  limited  or  not  completed  by  the 
physician,  especially  if  he  or  she  is  not  a 
"usual  source  of  care"  and  thus  may  not 
know  past  medical  problems.  Moreover, 
episode  techniques  depend  on  accurately 
maintained  data  files  organized  on  a 
person-by-person  basis  that  contain  all 
ambulatory  care  obtained  by  the 
individual. 

Quality-of-Care  Results 

The  findings  on  quality  of  care  as 
evaluated  by  the  episode-related  criteria 
were  important  in  several  respects.  First, 
the  beneficial  effect  of  the  New  Mexico 
EMCRO  on  injection  use,  especially  an- 
tibiotics, was  demonstrated  to  have  been 
substantial  and  achieved  with  no  decre- 
ment of  the  level  of  quality  of  care  of  other 
services.  The  decreases  in  use  of  potent 
injectable  antibiotics,  some  of  which  are 
unacceptable  therapies  for  certain  diseases 
or  in  patients  of  specific  ages,  represented 
a  clinically  meaningful  accomplishment. 
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This  result  confirms  that  areawide  peer  re- 
view organizations  can  play  a  major  role  in 
detecting  and  correcting  problems  in  the 
quality  of  care  and  in  maintaining  higher 
levels  of  care  thereafter. 

The  picture  was  not  all  bright,  however. 
The  earlier  analyses  based  on  ambulatory 
visits  were  restricted  to  injection  use,  and 
hence  little  light  was  shed  on  deficiencies 
in  quality  in  other  areas  (even  though  some 
residual  misuse  of  injections  was  de- 
tected). The  analyses  based  on  episodes, 
however,  clearly  documented  deficiencies 
in  quality  of  care  along  several  dimensions 
(use  of  contraindicated  oral  antibiotics  or  2 
antibiotics  when  1  would  do,  for  example, 
or  extremely  low  levels  of  diagnostic  pro- 
cedures). This  supports  the  view  that  prob- 
lems in  quality  of  care  are  by  no  means 
confined  to  rare  diseases  or  sophisticated 
technology  but  in  fact  are  observed  for 
widely  prevalent  conditions  in  generally 
healthy  populations  and  in  the  most  basic 
medical  services. 

This  finding  is  in  line  with  the  work  of 
other  researchers  going  back  many  years93 
but  in  general  the  documentation  of  de- 
ficiencies in  basic  medical  care  has  come 


from  research  designed  to  assess  quality  of 
care  for  specified  populations  (often  with  a 
single  illness),  in  particular  institutions 
(such  as  hospitals  or  clinics),  or  delivered 
by  particular  types  of  physicians.  In  addi- 
tion, such  studies  have  often  been  based  on 
medical  record  abstraction  or  specialized 
(often  one-time-only)  data  collection 
procedures. 

The  analyses  reported  here,  by  contrast, 
have  been  focused  on  a  relatively  healthy 
population  (albeit  one  with  special  charac- 
teristics with  respect  to  eligibility  for 
Medicaid)  and  oriented  toward  a  broad 
spectrum  of  primary  care  physicians.  They 
have  also  been  based  on  data  derived  from 
computerized  insurance  claim  files,  a 
source  of  medical  evaluation  information 
that  will  undoubtedly  become  more 
widely  used  in  the  future.  Moreover,  this 
population  was  a  stable  cohort  that  could 
be  studied  longitudinally.  The  characteris- 
tics of  the  episode  analyses,  therefore,  lend 
substantial  validity  to  the  findings  with  re- 
spect to  problems  in  quality  of  care,  differ- 
ences in  levels  of  quality  according  to 
physician-related  factors,  and  changes  over 
time  in  medical  practices. 
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VII.  Summary  and  Conclusions 


This  study  has  described  patterns  of  am- 
bulatory care  for  common  respiratory 
illnesses  and  examined  the  effect  of  the 
New  Mexico  Experimental  Medical  Care 
Review  Organization  (EMCRO)  on  the 
quality  of  care  for  persons  enrolled  in  the 
Medicaid  program  between  September 
1971  and  August  1975.  The  first  stages  of 
the  investigation  used  ambulatory  visits  as 
the  unit  of  analysis  and  focused  on  the  use 
of  all  injectable  drugs  and  on  IM  antibi- 
otics. The  last  stage  used  entire  episodes  of 
illness  of  6  common  respiratory  infections 
(strep  throat,  pharyngitis,  influenza,  bron- 
chitis, otitis  media,  upper  respiratory  tract 
infections)  as  the  analysis  unit,  and  focused 
on  the  use  of  IM  and  oral  antibiotics,  labor- 
atory tests,  and  follow-up  visits. 

Quality  of  care  was  evaluated  as  a  func- 
tion of  the  characteristics  of  the  physician 
giving  the  care;  the  effect  of  EMCRO  peer 
review  activities  was  assessed  over  time, 
using  a  quasi-experimental  approach  in- 
volving before  and  after  periods  and  a  de- 
fined population  cohort.  Period  I  referred 
to  the  time  before  any  significant  educa- 
tional or  review  activities  took  place;  Pe- 
riod II  was  after  the  major  effect  of  the 
EMCRO  had  occurred.  The  cohort  studied 
in  the  episode-of-care  analyses  comprised 
Medicaid  eligibles  enrolled  in  the  Aid  to 
Families  with  Dependent  Children 
(AFDC)  aid  category  continuously  for  all  4 
years;  it  changed  in  no  way  except  natural 
aging. 

EMCROs  can  be  considered  prototypes 
of  areawide  peer  review  organizations 
such  as  Professional  Standards  Review  Or- 
ganizations (PSROs).6,8,51  Many  aspects  of 
the  PSRO  program  have  been  modeled  on 
the  organizational  features  of  the  EMCRO. 
The  New  Mexico  EMCRO  in  particular 
had  a  comprehensive  review  program  for 
both  hospital  and  ambulatory  care  based 
upon  examining  claims  for  services  billed 


under  the  Medicaid  program.  In  addition, 
certain  parts  of  its  system  have  been 
suggested  for  adoption  by  PSROs,  espe- 
cially procedures  for  review  of 
ambulatory-care  claims.  Thus,  we  believe 
that  evaluation  of  the  New  Mexico 
EMCRO  should  provide  a  useful  guide  to 
assessing  the  degree  to  which  such  organi- 
zations might  improve  or  at  least  maintain 
the  quality  of  medical  care,  especially  in 
federally  funded  programs.  We  emphasize, 
however,  that  generalization  from  New 
Mexico  to  the  national  PSRO  program  is 
not  without  its  hazards,  because  New 
Mexico  is  basically  a  nonmetropolitan  area 
whose  Medicaid  population  is  predomi- 
nantly white  and  because  the  environment 
in  which  the  EMCRO  operated  was  excep- 
tionally conducive  to  undertaking  success- 
ful peer  review. 

We  confined  this  report  to  issues  involv- 
ing quality  of  medical  care  in  this  Medicaid 
population.  Equally  important  issues  on 
use  of  inpatient  hospital  care,  overall  utili- 
zation of  inpatient  and  outpatient  services, 
and  rising  costs  of  care  were  dealt  with 
elsewhere.8  A  few  analyses  were  exten- 
sions of  the  2-year  evaluation7  to  4  years. 
For  the  remainder,  2  major  elements  were 
added:  diagnosis  and  entire  episodes  of 
care. 


Principal  Findings 

1.  Simple  regression  equations  indi- 
cated that  the  use  of  all  injections  per 
Medicaid  eligible  declined  about  75  per 
cent  in  the  4  years  of  the  EMCRO' s  opera- 
tion. Most  of  this  effect  was  achieved 
within  2  years.  The  largest  drop  occurred 
after  the  institution  of  educational  and  in- 
formational efforts;  additional  decreases 
followed  initiation  of  strict  review  and  de- 
nial of  payment  for  inappropriate  services. 
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2.  Changes  in  injection  use  differed 
markedly  by  type  of  injection.  Very  large 
declines  in  the  use  of  injectable  drugs  were 
achieved  for  those  with  either  potentially 
serious  side  effects  or  specific  indications 
for  use,  including  certain  antibiotics  (lin- 
comycin,  ampicillin,  tetracycline,  and 
short  acting  [SA]  penicillin)  and  Vitamin 
B12.  Over  the  4-year  period,  the  EMCRO 
prevented  an  estimated  147,000  unneces- 
sary injections. 

3.  The  peer  review  process  was  based 
on  examining  use  of  services  as  a  function 
of  diagnosis.  Wholesale  changes  in  diag- 
noses recorded  on  claim  forms  could  have 
made  the  review  system  ineffective.  How- 
ever, no  overall  shift  in  diagnoses  to  ones 
that  might  provide  greater  justification  for 
those  services  under  intensive  review, 
such  as  antibiotic  injections,  was  observed. 

4.  In  treating  common  respiratory  infec- 
tions, the  various  types  of  physicians  ap- 
peared to  have  different  preferences  for 
specific  types  of  antibiotic  injections  irres- 
pective of  diagnosis;  that  is,  they  did  not 
obviously  select  antibiotics  according  to 
diagnosis.  Medical  doctors  (MDs)  tended 
to  prefer  SA  penicillin;  doctors  of  os- 
teopathy (DOs),  especially  outliers  (see  be- 
low), relied  on  lincomycin. 

5.  At  the  beginning  of  the  study,  quality 
of  care  as  measured  solely  by  the  use  of 
medically  inappropriate  injectable  drugs 
varied  markedly  by  physician  characteris- 
tics. In  particular,  group  practices  provided 
better  care  than  solo  practitioners,  MDs 
better  than  DOs,  and  board-certified 
physicians  better  than  noncertified  physi- 
cians. In  addition,  a  small  group  of  "out- 
lier" physicians  who  had  markedly  poor 
patterns  of  use  of  injectable  drugs  was  iso- 
lated. Twenty-two  physicians  (7  per  cent  of 
the  313  physicians  in  solo  practice  who 
gave  more  than  100  ambulatory  visits  in  the 
first  2  years  of  the  period  under  study)  gave 
14  per  cent  of  the  ambulatory  visits  but  had 
29  per  cent  of  the  injections  billed  and  41 
per  cent  of  the  injections  denied  for  medi- 
cal reasons. 


6.  The  peer  review  process  clearly  ac- 
complished 2  clinically  relevant  steps.  It 
reduced  the  use  of  antibiotic  injections  in 
the  treatment  of  viral  illnesses.  It  also 
changed  the  selection  of  an  antibiotic  in- 
jection (when  one  was  needed)  from  a  sec- 
ondary (or  inappropriate)  one  to  a  drug  of 
choice,  e.g.,  from  lincomycin  to  long-acting 
(LA)  penicillin. 

7.  Episodes  of  care  were  created  for  the 
following  common  respiratory  infections: 
streptococcal  sore  throat  (strep  throat), 
pharyngitis/tonsillitis,  bronchitis,  otitis 
media,  influenza  and  acute  upper  respira- 
tory infection  (acute  URI).  These  episodes 
included  ambulatory  care  given  for  the 
specific  (or  a  closely  related)  condition  and 
excluded  extraneous  care  that  may  have 
been  given  at  roughly  the  same  time  but 
not  for  the  same  illness. 

8.  Use  of  injectable  antibiotics  in  the  6 
respiratory  illnesses  studied  improved 
markedly  between  the  2  periods  studied. 
Use  of  injectable  tetracycline,  ampicillin, 
lincomycin,  and  SA  penicillin  dropped; 
use  of  injectable  LA  penicillin  rose.  These 
changes  were  not  accompanied  by  any  de- 
cline in  quality  of  care  as  judged  by  criteria 
involving  prescription  drugs.  No  shift  from 
inappropriate  IM  to  inappropriate  oral  an- 
tibiotics was  observed. 

9.  Physicians  differed  markedly  in  the 
quality  of  care  provided,  as  judged  by  min- 
imal criteria  involving  use  of  all  antibiotic 
medications  and  use  of  appropriate  diag- 
nostic procedures.  In  general,  group  prac- 
tices provided  better  care  than  solo  provid- 
ers, MDs  better  than  DOs,  board-certified 
physicians  better  than  noncertified  physi- 
cians, and  nonoutliers  better  than  outliers. 
For  example,  in  Period  I,  patients  with 
simple  colds  (i.e.,  acute  URI)  seen  by 
group  practices  were  correctly  treated  78 
per  cent  of  the  time,  compared  with  45  and 
56  per  cent  of  the  time  by  certified  MDs 
and  DOs,  and  33  and  2  per  cent  of  the  time 
by  outlier  MDs  and  DOs.  In  Period  II,  the 
figures  were  81  per  cent  for  group  prac- 
tices, 54  and  77  per  cent  for  certified  physi- 
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cians,  and  55  and  32  per  cent  for  outliers. 

10.  On  average,  quality  of  care  for  this 
Medicaid  population  was  still  deficient, 
even  after  the  major  impact  of  the  EMCRO 
on  injection  use.  For  example,  56  per  cent 
of  the  pharyngitis  episodes  were  treated 
appropriately  in  Period  II  (76  per  cent  for 
group  practices  and  certified  MDs,  38  and 
37  per  cent  for  outlier  MDs  and  DOs).  For 
other  respiratory  diseases,  the  percentage 
of  episodes  judged  to  have  been  treated 
appropriately  in  Period  II  were  as  follows: 
strep  throat,  42  per  cent;  otitis  media  in 
children  less  than  5  years  old,  55  per  cent; 
otitis  media  in  children  aged  5  to  7  years, 
78  per  cent;  bronchitis,  81  per  cent;  in- 
fluenza, 47  percent;  and  acute  URI,  51  per 
cent. 

Use  of  oral  tetracycline  in  children  less 
than  8  years  old  remained  unjustifiably 
high.  Among  children  in  this  age  group, 
about  5  per  cent  of  acute  URI  or  pharyn- 
gitis episodes  and  16  per  cent  of  bronchitis 
episodes  were  treated  with  oral 
tetracycline. 

11.  Few  follow-up  visits  in  episodes  of 
otitis  media  were  observed  in  either  pe- 
riod. In  Period  I,  patients  in  29  per  cent  of 
all  otitis  media  episodes  had  a  revisit 
within  6  weeks  after  the  onset  of  the  dis- 
ease; in  Period  II,  the  respective  figure  was 
25  per  cent.  In  Period  II,  at  least  1  revisit 
was  recorded  for  30  per  cent  of  otitis  media 
episodes  seen  by  group  practices,  23  per 
cent  of  those  seen  by  certified  MDs,  20  per 
cent  of  those  seen  by  certified  DOs,  29  per 
cent  of  those  seen  by  outlier  MDs  and  29 
per  cent  of  those  seen  by  outlier  DOs. 

12.  Use  of  diagnostic  tests  rose  slightly 
over  time  for  these  infectious  diseases,  but 
was  still  extremely  low  in  both  periods. 
This  was  especially  true  for  throat  or  strep 
cultures.  On  average,  throat  cultures  were 
used  in  1 1  per  cent  of  pharyngitis  episodes 
in  Period  II,  and  in  21  per  cent  of  strep 
throat  episodes  (conditions  for  which  such 
tests  should  probably  be  routine  in  at  least 
one-half  of  patients).  The  range  of  use  of 
throat  cultures  in  the  treatment  of  pharyn- 


gitis in  Period  II  was  from  0  per  cent  for 
outliers  to  29  per  cent  for  group  practices; 
in  the  treatment  of  strep  throat,  use  ranged 
from  1  per  cent  for  outliers  to  44  per  cent  for 
group  practices. 

Discussion 

The  EMCRO's  effect  on  injection  use 
and  thereby  on  the  quality  of  ambulatory 
care  is  unquestioned.  When  evaluated 
over  time  by  provider  characteristics, 
diagnoses,  ambulatory  visits  and  entire 
episodes  of  illness,  sustained  reductions  in 
injection  use  were  seen  to  be  achieved 
among  those  classes  of  drugs  targeted  by 
EMCRO  injection  guidelines.  These  im- 
provements in  quality  were  obtained 
without  prompting  poor  practices  in  other 
areas. 

The  timing  of  the  considerable  drop  in 
injections  use  suggested  that  the  dual  ap- 
proach of  the  EMCRO  was  both  practical 
and  successful.  In  particular,  the  educa- 
tional activities  that  surrounded  develop- 
ment and  promulgation  of  the  injection 
guidelines  had  a  substantial  impact;  the 
subsequent  economic  sanctions  in  the 
form  of  denial  of  payments  for  claims  for 
inappropriate  services  was  a  useful  ad- 
junct. The  New  Mexico  PSRO  later 
adopted  a  similar  2-committee  approach  to 
deal  with  problems  among  selected  physi- 
cians; one  used  purely  educational  and 
informational  efforts,  the  other  more  sub- 
stantial review  activities  and  sanctions  (in- 
cluding denial  of  payment  for  services). 

Remaining  Quality-of-Care  Problems 

Other  problems  that  these  analyses  iden- 
tified in  the  quality  of  ambulatory  care  for 
these  common  infectious  diseases  relate  to 
the  use  of  oral  antibiotics  when  they  either 
are  not  indicated  or  are  not  the  drug  of 
choice,  to  some  continuing  misuse  of  a  few 
injectable  drugs  (not  necessarily  antibi- 
otics), and  to  a  continued  low  level  of  use  of 
pertinent  diagnostic  tests.  The  major  prob- 
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lems  in  the  use  of  oral  antibiotic  therapies 
might  well  be  attacked  first  through  an 
educational  program,  not  payment  denial. 
This  would  involve  the  following  tasks:  1) 
Establish  guidelines  for  use  of  prescription 
drugs,  especially  antibiotics,  in  much  the 
same  way  as  was  done  for  injections;  2) 
Disseminate  this  information  widely 
among  New  Mexico  Medicaid  physicians 
(and  perhaps  pharmacists);  and  3)  Estab- 
lish review  procedures  that  would  allow 
monitoring  of  claims  with  these  particular 
guidelines  explicidy  in  mind  so  that  physi- 
cians continuing  to  misuse  drugs  could  be 
identified  for  more  intensive  educational 
efforts. 

Prescription  claims  review  with  the  ob- 
jective of  denying  payment  would  be  less 
likely  to  be  effective.  In  the  present  sys- 
tem, if  payment  for  a  claim  for  a  prescrip- 
tion were  denied,  the  pharmacist  rather 
than  the  physician  giving  the  prescription 
is  the  one  who  would  be  penalized.  To 
determine  if  a  drug  is  medically  appropri- 
ate and  to  assign  sanctions  correctly,  a 
pharmacy  claim  for  a  prescription  drug 
(which  lacks  diagnoses)  would  need  to  be 
matched  with  a  physician  claim  (which 
contains  diagnoses),  or  some  other  routine 
procedure  would  need  to  be  established 
that  placed  responsibility  for  an  inappro- 
priate prescription  on  the  physician  rather 
than  the  pharmacist.  Encouraging  phar- 
macies to  maintain  drug  profiles  on  pa- 
tients and  to  contact  prescribing  physicians 
in  the  event  of  unjustified  quantities  or 
combinations  of  drugs  might  be  attempted 
by  PSROs,  as  has  been  tried,  for  example, 
in  Utah.9  These  mechanisms  could  be  both 
time-consuming  and  expensive,  but  as  a 
general  principle,  sooner  or  later  the  peer 
review  movement  must  find  ways  to  make 
the  initiating  physician  accountable  for 
services  that  are  dispensed  through  a  third 
party. 

As  for  the  problem  of  continuing  misuse 
of  IM  drugs,  several  steps  might  be  consid- 
ered. Renewed  educational  interventions 
might  be  directed  at  physicians  clearly  still 
disregarding    EMCRO    (now  PSRO) 


guidelines,  perhaps  with  emphasis  on 
drugs  that  are  almost  always  not  indicated 
for  the  bulk  of  the  acute  conditions  encoun- 
tered in  a  Medicaid  population.  The  New 
Mexico  PSRO  undertook  activities  of  this 
sort  for  tetracycline  and  chloramphenicol 
as  part  of  their  ambulatory  care  review 
demonstration  project.29 

When  special  circumstances  suggest 
underutilization  of  some  services  (such  as 
throat  cultures  as  described  in  this  study), 
arguing  for  wholesale  increase  s  in  their  use 
would  be  unwise  and  unwarranted. 
Rather,  for  providers  who  exhibit,  over 
time,  patterns  of  submitting  claims  for  serv- 
ices for  illnesses  in  which  the  choice  of 
appropriate  therapy  probably  requires  a 
diagnostic  test  (e.g.,  strep  throat  among  the 
respiratory  infections,  or  conditions  such 
as  anemia),  but  who  rarely  if  ever  do  the 
relevant  test,  selective  educational  efforts 
might  be  undertaken.  For  example,  one 
explanation  for  the  extremely  low  use  of 
throat  cultures  in  New  Mexico  might  be 
that  solo  practitioners  in  rural  counties 
encountered  difficulties  getting  such 
tests  done  and  results  returned  in  a  timely 
fashion  if  they  had  to  rely  on  outside 
laboratories.  In  such  situations,  a  peer  re- 
view organization  might  undertake  to  pro- 
vide some  assistance  and  education  on 
how  such  cultures  could  be  reliably  done 
in  the  physicians'  own  offices.  Sanctions  in 
the  form  of  denials  of  payment  for  the  serv- 
ices that  are  billed  would  probably  be  a 
less  effective  tool  for  this  problem,  at  least 
as  a  first  step.  Incentives  in  the  form  of 
higher  payments  for  such  services  poten- 
tially risks  prompting  excessive  use,  which 
in  turn  raises  the  possibility  that  PSROs 
would  have  to  expend  additional  resources 
to  guard  against  overutilization. 

Other  Applications  for  the  Episode  Methods 

Outlier  Physicians.  Obviously,  officials 
must  decide  at  some  point  whether  physi- 
cians who  disregard  quality-related 
guidelines  or  who  clearly  provide  sub- 
standard care  along  many  dimensions 
should  be  dropped  from  Medicaid  pro- 
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vider  rolls.  In  a  state  such  as  New  Mexico, 
such  a  step  could  have  the  unfortunate  ef- 
fect of  curtailing  Medicaid  eligibles'  access 
to  care,  for  at  least  2  reasons:  remaining 
physicians  may  be  unable  or  unwilling  to 
accept  additional  Medicaid  patients,  leav- 
ing them  without  physician  coverage,  and 
in  remote  areas,  there  may  not  be  any  other 
physicians  in  practice.  To  make  such  a  de- 
cision, some  judgment  must  be  made  as  to 
whether  the  totality  of  the  care  provided  to 
Medicaid  patients  is  sufficiently  bad  that, 
on  balance,  potentially  more  harm  than 
good  is  done  by  allowing  such  providers  to 
remain  on  the  Medicaid  rolls. 

It  is  here  that  an  episode  approach  may 
offer  the  best  available  analytic  tool,  given 
that  outright  experimentation  is  impossi- 
ble and  that  outcome-based  quality-of-care 
assessment  from  data  based  on  claim  forms 
is  at  best  exploratory  and  poorly  de- 
veloped. Evaluating  the  care  given  for  en- 
tire episodes  of  illness  potentially  gives  a 
much  clearer  picture  of  the  overall  level  of 
care  delivered  by  questionable  providers, 
thereby  enhancing  the  confidence  with 
which  a  decision  could  be  made  about 
maintaining  a  physician  on  Medicaid  lists. 
Obviously,  investigation  and  personal  in- 
tervention on  the  part  of  peer  physicians 
and  Medicaid  officials  would  be  needed  as 
well.  The  point  is  that  episode  analysis  of- 
fers a  more  comprehensive  and  meaning- 
ful early-warning  and  screening  mecha- 
nism than  may  have  been  tried  in  the  past. 

In  general,  our  initial  concept  of  "out- 
liers" involved  errors  of  commission — i.e., 
giving  too  many  services  (in  this  case 
medications)  of  questionable  usefulness  or 
relevance.  Theoretically,  outliers  can  and 
should  also  be  defined  in  terms  of  errors  of 
omission — i.e.,  not  giving  appropriate  serv- 
ices when  they  are  justified.  Very  low  use 
of  laboratory  and  diagnostic  tests  for  condi- 
tions that  cannot  be  diagnosed  on  the  basis 
of  signs  and  symptoms  alone  is  an  example. 

The  outliers  in  this  study,  who  were 
identified  initially  on  the  basis  of  excessive 
use  of  inappropriate  injections,  were  also 
found  to  be  outliers  in  regard  to  broader 


diagnosis-specific  criteria  involving  IM 
and  oral  antibiotics  and  appropriate  use  of 
diagnostic  tests.  That  is,  errors  of  both 
commission  and  omission  were  indeed  in- 
volved. Such  findings  certainly  seem  to 
justify  placing  such  physicians  on  100  per 
cent  prepayment  review.  If  such  results  are 
replicated,  PSROs  may  need  to  consider 
developing  2  ambulatory  care  review 
mechanisms.  These  would  necessarily  be 
based  on  different  sets  of  incentives  and 
sanctions  that  would  promote  the  most  ef- 
ficient review  of  outlier  physicians. 

Chronic  Conditions.  Assessing  care  for 
chronic  conditions  is  theoretically  analog- 
ous to  assessing  acute  care.  The  two  main 
differences  are  that  the  episode  concept 
must  be  extended  over  a  much  longer  time 
and  the  appropriateness  of  services  and 
medications  often  must  be  judged  in  the 
presence  of  specified  sets  of  diagnoses 
and/or  other  specified  services  and  medi- 
cations, and  often  within  some  more-or- 
less  arbitrary  number  of  days.  For  example, 
the  need  for  follow-up  visits  may  be  pre- 
dicated on  continuing  use  of  a  particular 
medication,  or  the  need  for  one  medication 
may  be  predicated  on  the  use  of  a  com- 
plementary drug. 

PSROs  can  find  ways  to  organize  data 
bases,  claims  review  procedures,  and  in- 
formation collection  and  processing  mech- 
anisms to  maximize  the  potential  for  re- 
viewing entire  episodes  of  care,  both 
chronic  and  acute.  Such  steps,  which 
would  require  cooperation  from  state 
Medicaid  programs  and  fiscal  inter- 
mediaries, include  organizing  data  files  on 
a  person-by-person  basis  (as  in  New 
Mexico)  rather  than  family-by-family. 
Another  is  careful  monitoring  of  eligibility; 
analyses  of  "episodes"  of  care  for  persons 
who  go  on  and  off  the  Medicaid  rolls  is 
nearly  impossible  because  of  missing  in- 
formation on  services  that  might  have  been 
received  in  periods  of  noneligibility.  A 
third  is  modifying  claim  forms  so  that  serv- 
ices can  be  linked  directly  to  diagnoses  or 
problems  by  the  physician  providing  the 
care.  The  latter  diminishes  the  need  for  so 
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many  algorithms  to  create  episodes,  and 
thus  makes  an  episode  methodology  much 
more  practical. 

Long-Term  Objectives  of  a  PSRO  Program 

Focusing  on  Outliers  or  Typical  Physi- 
cians. The  question  sometimes  arises  as  to 
whether  the  chief  objective  of  peer  review 
organizations  should  be  to  raise  the  level  of 
care  given  by  the  poorest  providers  up  to  a 
level  approaching  the  average,  or  to  at- 
tempt to  improve  the  general  level  of  care 
given  by  all  physicians.  In  our  view,  both 
objectives  may  need  to  be  pursued  more- 
or-less  simultaneously.  The  levels  of  qual- 
ity of  care  provided  by  the  outlier  physi- 
cians, for  example,  were  not  tolerable  for 
any  length  of  time;  the  levels  of  care  given 
by  the  poorest  providers  needed  im- 
provement even  if  little  or  no  attention 
were  paid  to  the  care  given  by  more  ac- 
complished physicians.  On  the  other  hand, 
the  episode-of-illness  analyses  clearly  in- 
dicated that  all  types  of  physicians  ex- 
hibited deficiencies  in  handling  common 
conditions;  a  reasonable  inference  is  that 
less  prevalent  diseases  are  not  likely  to  be 
handled  at  any  higher  level  of  quality. 
Over  the  long  run,  therefore,  care  deliv- 
ered by  the  typical  physician  should  re- 
ceive explicit  attention  from  peer  review 
organizations. 

Reducing  Variation  in  Care.  Reducing 
the  variance  in  the  levels  of  quality  of  care 
provided  is  an  important  step  in  terms  of 
assuring  high-quality  care  for  entire  popu- 
lations, in  particular  for  populations  such 
as  those  enrolled  in  the  Medicaid  program, 
for  whom  the  freedom  to  choose  physicians 
may  be  less  than  in  a  nondisadvantaged 
population.  Clearly,  the  EMCRO  suc- 
ceeded in  reducing  the  variance  in  quality 
of  care  by  markedly  improving  the  care 
given  by  the  poorest  physicians,  without 
prompting  any  decline  in  the  average  level 
of  care  given  by  other  physicians. 

Some  observers,  however,  have  decried 
just  such  a  phenomenon,  arguing  for 


example  that  peer  review  oriented  toward 
the  process  of  care  will  decrease  patients' 
selection  of  physicians,  restrict  patients' 
search  among  physicians  for  suitable  care, 
and,  most  importantly,  discourage  physi- 
cian innovation  or  individually  tailored, 
nonstandard  care  for  conditions  where  de- 
viant treatment  may  be  as  or  more 
effective.10 

In  theory,  these  are  legitimate  concerns; 
in  practice,  they  may  be  more  apparent 
than  real.  First,  overly  prescriptive  or  pres- 
criptive peer  review  guidelines  would  of 
course  be  undesirable  if  applied  rigidly, 
uniformly  and  unthinkingly.  The  essence 
of  peer  review  as  carried  out  by  EMCROs 
or  PSROs,  however,  is  that  individual 
cases  (patient-specific  or  provider- 
specific)  can  be  identified  for  review  ac- 
cording to  relatively  strict  criteria  but  that 
peer  judgments  are  made  on  the  basis  of  all 
available  information.  Such  circumstances 
obviously  permit  "nonstandard"  care  to  be 
considered  acceptable  in  individual  cases. 

Second,  it  must  be  remembered  that 
federally  mandated  peer  review  is  aimed 
only  at  programs  financed  by  public 
monies.  Individuals  who  wish  to  acquire 
care  that  falls  outside  commonly  accepted 
norms — e.g.,  antibiotics  for  a  common  cold, 
chiropractic  therapy  for  headache,  or  estro- 
gen injections  for  mild  anxiety  or 
depression — can  exercise  that  option  by 
paying  for  such  care  privately.  Programs 
with  entitlements  based  on  age,  disability 
or  poverty,  such  as  Medicare  and 
Medicaid,  should  always  be  required  to 
guard  against  2-class  level  of  care,  but  they 
should  also  be  required  to  be  accountable 
to  the  society  at  large  that  underwrites  their 
expenditures.  This,  in  turn,  means  that 
they  should  not  be  expected  to  subsidize 
services  that  society — in  this  case  (but  not 
necessarily  in  all  cases)  articulated  through 
the  professional  judgment  of  peer 
physicians — deems  unsuitable. 

Third,  our  approach  was  to  assess 
changes  in  quality  according  to  a  set  of 
minimal  criteria  that  gave  a  good  deal  of 
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leeway  to  the  physician.  The  reduction  in 
variation  in  care  reflected  improvements 
among  physicians  falling  below  the 
minimum.  Because  such  physicians  deliv- 
ered a  substantial  amount  of  care  to  the 
Medicaid  population,  this  pattern  of  im- 
provement in  quality  of  care  raised  the 
probability  that  such  eligibles  eventually 
had  greater  access  to  better  care.  This  type 
of  accomplishment  certainly  has  meaning 
for  those  who  live  at  distances  or  in  cir- 
cumstances that  preclude  their  seeking 
care  from  the  best  physicians,  e.g.,  those 
who  have  no  easy  means  of  transpor- 
tation from  outlying  counties  to  metropoli- 
tan areas  or  those  lacking  convenient  and 
inexpensive  transportation  in  urban  areas. 

Improving  Ways  of  Using  Insurance 
Claims  Data.  Review  of  the  quality  of  am- 
bulatory care  may  increasingly  be  done  on 
insurance  claims  data,  especially  in  cir- 
cumstances where  physician-led  organiza- 
tions are  willing  to  use  such  information  to 
improve  care  (clearly  the  case  in  New 
Mexico).  The  deficiencies  in  care  detailed 
here  are  precisely  those  noted  by  numer- 
ous investigators  in  both  disadvantaged 
and  nondisadvantaged  populations,  often 
using  medical  record  audits  or  odier  re- 
search techniques.93  They  were  uncovered 
in  a  fairly  straightforward  way,  using  sim- 
ple process  criteria  that  asserted  that  cer- 
tain services  or  medications  should  or 
should  not  be  used  in  given  instances  for 
specific  diagnoses.  Care  given  in  the 
Medicaid  program  in  New  Mexico  is  un- 
likely to  differ  in  any  meaningful  way  from 
that  given  in  similar  populations 
elsewhere,  notwithstanding  the  earlier 
caveat  about  generalizations  from  the  New 
Mexico  EMCRO  per  se.  Thus,  the  argu- 
ment is  strengthened  that  claim  data  bases, 
which  can  only  grow  in  size  and  richness 
over  the  years,  can  and  should  be  exploited 
for  quality  assurance  purposes. 

The  PSRO  program  must  identify  ways 
to  pursue  its  quality-of-care  mandate  more 
efficiently,  especially  with  respect  to 
common  conditions.  Given  the  nature  of 


claims  data  bases  in  federally  funded  pro- 
grams and  the  potential  for  creating  com- 
puterized episodes  of  illness,  physician 
and  patient  profiles  and  so  forth,  attention 
might  be  directed  first  to  those  problems 
that  are  uncovered  through  epidemiologi- 
cal approaches — statistical  aggregation 
and  analysis  of  data — rather  than  through 
isolated  incidents  or  problems  that  may 
come  to  the  attention  of  peer  review  or- 
ganizations through  patient  or  provider 
complaints,  random  events  such  as  mal- 
practice suits,  or  even  professional  judg- 
ments as  to  potential  local  problems. 
Mechanisms  by  which  these  claims  data 
bases  can  be  used  in  the  most  statistically 
meaningful  way  to  pinpoint  generic  prob- 
lems in  the  delivery  of  care  must  be  de- 
veloped, and  this  must  be  done  in  ways 
that  can  focus  on  procedures  and  services, 
characteristics  of  physicians,  and  charac- 
teristics of  patients  in  various 
combinations. 

Targeting  on  Diagnoses  or  Problems. 
The  question  might  be  raised  as  to  whedier 
ambulatory  care  review  should  itself  be  fo- 
cused on  selected  diseases  or  conditions 
(in  much  the  same  manner  that  Medical 
Care  Evaluations  in  the  PSRO  inpatient 
hospital  program  are  oriented  toward  par- 
ticular diagnoses).  The  conclusion  from  the 
episode-of-care  analyses  would  seem  to  be 
that  attempting  to  isolate  particular  diag- 
noses for  intensive  review  may  not  be  a 
particularly  fruitful  approach,  chiefly  be- 
cause the  deficiencies  in  quality  of  care  cut 
across  most,  if  not  all,  of  the  common  diag- 
noses studied  here.  Thus,  attempting  to 
identify  generic  problems  in  quality  of  care 
on  the  basis  of  literature  reviews,  empirical 
research  such  as  that  reported  here,  and 
analysis  of  quality-related  data  aggregated 
over  time  may  well  be  the  preferred  av- 
enue for  peer  review  organizations  to  take. 

Setting  Local  or  National  Criteria.  The 
issue  of  local  versus  national  standards  or 
criteria  for  quality-of-care  review  is  par- 
ticularly relevant  as  the  national  PSRO 
program  initiates  its  ambulatory  care  re- 
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view  efforts  in  more  than  the  present  hand- 
ful of  demonstration  projects.  Experience 
with  the  EMCRO  program  suggests  that 
local  EMCROs  tended  to  start  from  scratch 
in  developing  criteria.  This  may  have  had 
certain  beneficial  aspects,  such  as  facilitat- 
ing implementation  of  peer  review  at  the 
local  level,  but  it  may  well  be  inefficient  in 
a  national  program,  especially  when 
criteria  are  unlikely  to  differ  in  marked  ways. 
Thus,  a  good  deal  of  thought  should  be 
given  to  developing  nationally  applicable 
guidelines  for  certain  services,  at  least  in 
cases  where  little  or  no  exception  could  be 
taken  to  the  nature  or  form  of  die  recom- 
mendations. The  National  Council  of  the 
PSRO  program  might  be  a  good  starting 
point  lor  such  an  endeavor,  because  of  die 
likely  ability  of  such  a  group  to  overcome, 
or  at  least  mute,  regional  biases  or  predilec- 
tions. A  possible  focus  of  their  attention  at 
first  might  be  injectable  or  oral  antibiotics 
in  ambulatory  care,  because  of  the  evi- 
dence nationwide  as  to  the  misuse  of  these 
drugs  lj n'14>42'47'48'68-77'78 

Costs  of  Peer  Review 

No  quality-of-care  activity  is  without  its 
costs.  Peer  review  efforts  in  New  Mexico, 
including  both  administrative  and 
quality-of-care  review,  were  estimated  to 
cost  about  3  per  cent  of  the  total  amount 
spent  on  personal  medical  services,8  and 
that  figure  is  not  an  unreasonable  estimate 
for  an  analogous  nationwide  program. 
Many  of  the  data  collection  and  mainte- 
nance activities  that  are  required  for 
quality-of-care  review,  however,  are  al- 
ready subsumed  within  the  administrative 
and  operational  tasks  handled  by  fiscal  in- 
termediaries. Administrative  and  medical 
review  tasks,  therefore,  take  on  the  nature 
of  joint  products,  in  that  the  actual  cost  of 
doing  either  set  of  activities  cannot,  strictly 
speaking,  be  disaggregated  and  assigned  to 
one  or  the  other.  Even  so,  some  nontrivial 
costs  over  and  above  the  purely  adminis- 
trative ones  obviously  accrue  to  medical 


review  of  quality  of  care,  and  several  ques- 
tions arise  with  respect  to  such  costs. 

First,  what  is  the  amount  of  direct  and 
indirect  costs  of  quality  review  activities? 
These  include  not  only  measurable  operat- 
ing costs,  but  also  imputed  costs  of  physi- 
cian time  if  it  is  volunteered,  potential 
costs  of  avoiding  detection  of  substandard 
practices  on  the  part  of  some  physicians, 
and  possible  costs  of  substituted  services  to 
make  up  for  revenues  lost  from  other  de- 
nied services. 

Second,  should  improvements  in  quality 
of  care  be  expected  to  lead  to  overall  sav- 
ings in  medical  expenditures?  If  so,  how 
should  such  improvements  be  valued — as 
the  imputed  cost  of  poor  services  not  given, 
as  substitutes  of  a  more  efficient  package  of 
services  for  a  less  efficient  one,  or  by  some 
other  metric?  Other  economic  questions 
then  arise,  including  those  involving  calcu- 
lations of  present  discounted  value  of  im- 
provements realized  in  the  future,  the  ac- 
tual discount  rate  to  use,  and  the  time 
frame  over  which  to  estimate  such 
benefits. 

Third,  assuming  that  no  "savings"  from 
quality-of-care  review  are  realized,  does 
society  nonetheless  value  improving  qual- 
ity of  care  sufficiently  to  mandate  expendi- 
ture of  substantial  sums  of  money  on  such 
activities,  when  such  resources  might  be 
put  to  use  in  other  ways,  such  as  delivering 
more  or  different  services  (e.g.,  as  might 
happen  if  deductibles  and  copayments  in 
Medicare  were  reduced)  or  expanding 
medical  facilities? 

Fourth,  is  better  quality  of  care  more  or 
less  expensive  than  poorer  quality  of  care? 
The  conventional  wisdom  is  that  higher 
quality  costs  more;  this  view  apparently 
arises  in  part  from  the  belief  that  higher 
quality  is  related  to  use  of  more  extensively 
trained  physicians,  greater  reliance  on 
more  technologically  advanced  services, 
and  other  cost-enhancing  factors  such  as 
the  substitution  of  more  sophisticated  or 
sensitive  tests  for  less  useful  ones. 

Our  evidence  bears  only  slightly  on  most 
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of  these  questions.  Regarding  the  last, 
however,  our  results  suggest  that  higher 
quality  of  care  may  not  inevitably  be  re- 
lated to  higher  costs  of  care.  This  conclu- 
sion is  based  principally  on  the  findings, 
which  need  to  be  replicated  elsewhere, 
that  one  major  quality-of-ambulatory-care 
problem  was  overmedication — in  particu- 
lar, overuse  of  oral  and  injectable  antibio- 
tics. To  the  degree  that  such  overmedica- 
tion can  be  curtailed,  it  follows  that  higher 
quality  of  care  should  not  be  more  costly. 

The  crucial  assumption,  of  course,  is  that 
elimination  of  overmedication  does  not 
simultaneously  prompt  greater  use  of  un- 
necessary services  in  some  other  arena  or  a 
rise  in  other  services  made  necessary  by 
the  simple  act  of  curtailing  antibiotic  use; 
the  latter  might  occur  if  substantial  in- 
creases were  observed  in  throat  cultures 
for  patients  not  treated  for  pharyngitis  or  in 
follow-up  physician  visits  for  patients  with 
sore  throats,  fever,  and  no  clear-cut  diag- 
nosis. Moreover,  even  if  both  prescription 
and  injectable  drugs  are  reviewed,  reduc- 
ing overmedication  may  not  lower  total 
medical  costs  in  any  meaningful  way,  be- 
cause of  the  relatively  small  fraction  of 
costs  that  they  represent  (perhaps  10  per 
cent).8  Finally,  conclusions  drawn  from 
examples  based  on  medication  use  should 
not  be  generalized  extensively  to  other 
ambulatory  services.  Further  analyses  with 
respect  to  these  cost/quality  issues  are  cer- 
tainly needed,  especially  ones  based  on 


episodes  of  care  that  are  constructed  to  be 
as  comprehensive  and  specific  as  possible 
and  that  include  procedures  and  services 
for  which  costs  may  be  high  but  the  margi- 
nal benefit  positive. 

Summary 

This  study  confirmed  that  peer  review 
undertaken  by  a  local  organization  of 
physicians  substantially  improved  the 
level  of  quality  of  care  provided  to  persons 
enrolled  in  the  New  Mexico  Medicaid  pro- 
gram. It  demonstrated  that  quality  assess- 
ment using  claims  data  could  be  carried  out 
through  analyses  based  on  entire  episodes 
of  care  and  that  the  quality  of  care  for  com- 
mon conditions  fell  below  acceptable 
levels  (in  particular,  that  oral  and  injecta- 
ble antibiotics  were  often  misused),  that 
these  deficiencies  varied  by  types  of 
physicians  giving  the  care,  and  that  efforts 
are  still  needed  to  bring  care  in  this  disad- 
vantaged population  up  to  acceptable 
levels.  Generalizing  extensively  from  this 
New  Mexico  experience  is  inappropriate, 
but  if  such  findings  were  replicated  in 
other  PSRO  sites  and  other  populations 
(which  seems  entirely  likely),  then  in- 
vestments in  quality  assessment  clearly  are 
warranted.  Society  must  then  specify 
clearly  how  much  improvement  in  quality 
of  care  through  peer  review  mechanisms 
must  take  place  to  justify  the  requisite — 
and  considerable — expenditures  of  public 
funds  on  such  endeavors. 
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APPENDIX  A 

Distribution  of  Services  in 
Diagnosis-Specific  Episodes  Specified 
as  2,  3  or  4  Weeks  in  Length 
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APPENDIX  B 


Percentage  Distribution  of  Antibiotic  Medications 
in  Diagnosis-Specific  Episodes,  by  Type  of  Drug, 
Type  of  Physician  and  Period 

The  tables  in  Appendix  B  (6A-13B)  are  organized  as  follows:  Each  pair 
presented  on  facing  pages  refers  to  one  of  the  diagnoses  under  study;  the 
table  on  the  left-hand  page  refers  to  Period  I  and  the  one  on  the  right-hand 
page  refers  to  Period  II. 

The  numbers  in  parentheses  in  the  headings  are  the  numbers  of 
episodes  seen  by  the  provider  type. 

The  medications  listed  are  all  antibiotics.  Drugs  before  the  virgule(/) 
are  injections  administered  by  the  physicians  (or  proxy).  Those  after  the 
virgule  are  written  or  telephoned  prescriptions  filled  at  a  pharmacy.  The 
antibiotic  entries  (rows)  are  listed  in  order  of  the  frequency  with  which 
they  were  observed  in  Period  I.  "Per  cent  of  episodes"  is  the  percent- 
age of  all  episodes  of  the  diagnosis  that  is  accounted  for  by  the  listed 
injectable  and  oral  antibiotics.  Bicillin  refers  to  the  form  of  LA  peni- 
cillin used  by  the  providers  studied. 

MD  indicates  a  doctor  of  medicine;  DO  indicates  a  doctor  of  osteopathy. 
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